00000001:02000400:0.0F:1788925063.809116:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788925082.927450:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788925084.919993:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 627 MB/s 00000001:01000000:2.0:1788925085.170268:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 883 MB/s 00000001:01000000:3.0F:1788925085.420107:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4503 MB/s 00000020:02000000:0.0:1788925086.116282:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_56_gc16f486 00000400:02000000:3.0:1788925086.994932:0:3288:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.104@tcp [8/256/0/180] 00008000:02000000:2.0:1788925090.881581:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788925145.061015:0:5245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788925155.290594:0:5819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788925155.290600:0:5819:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788925155.290715:0:5819:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e4f96f7f 00000080:02000400:2.0:1788925155.290724:0:5819:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788925155.297050:0:5819:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788925155.297064:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788925155.297196:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007589cfca) 00000020:00000080:3.0:1788925155.297216:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788925155.316773:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788925155.317357:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788925155.356360:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788925155.356393:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788925155.356410:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788925155.356454:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788925155.356473:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788925155.357089:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788925155.357096:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788925155.357106:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb29fc47e1a291177 00000020:01000004:2.0:1788925155.357123:0:5819:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788925155.357129:0:5819:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788925155.357133:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e4f96f7f from MGS 00000020:01000004:2.0:1788925155.357137:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788925155.357153:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000068972782) 00000020:00000080:2.0:1788925155.357162:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788925155.357250:0:5819:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e4f96f7f from MGS, refs=2 00080000:01000000:2.0:1788925155.357254:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788925155.357258:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb29fc47e1a291185 00000100:00100000:2.0:1788925155.357338:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788925155.357455:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788925155.357460:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788925155.358494:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788925155.358506:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788925155.359452:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925155.359734:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788925155.359739:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788925155.360815:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788925155.360823:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788925155.361287:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788925155.361293:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788925155.362295:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925155.362299:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925155.362301:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925155.362588:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925155.362591:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925155.362592:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925155.363521:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788925155.373794:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788925155.613040:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2855 MB/s 00000001:01000000:1.0F:1788925155.863353:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3327 MB/s 00000001:01000000:0.0:1788925156.114909:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 543 MB/s 00000001:01000000:3.0:1788925156.366407:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 589 MB/s 00080000:10000000:3.0:1788925156.398480:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1788925156.416863:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788925156.419655:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788925156.419669:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788925156.419672:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788925156.421903:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788925156.421990:0:5819:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788925156.426719:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788925156.426969:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788925156.426996:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788925156.427354:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788925156.427518:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788925156.427524:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788925156.433965:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788925156.433977:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788925156.446041:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788925156.446054:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788925156.447082:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788925156.447113:0:5819:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.104@tcp' 00000020:01000004:1.0:1788925156.447115:0:5819:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788925156.447158:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.104@tcp (typ=mgc) 00000020:00000080:1.0:1788925156.447179:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.104@tcp (000000000ce0120a) 00000020:00000080:1.0:1788925156.447198:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788925156.447349:0:5819:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000086f60f6c@MGC192.168.203.104@tcp: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788925156.447991:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.104@tcp-0 is initialized 00000040:01000000:1.0:1788925156.447998:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788925156.449257:0:5834:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788925156.463925:0:5836:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788925156.464101:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.104@tcp (uuid 76f68b46-a017-4297-a662-44212e04e46d) 00000020:00000080:1.0:1788925156.464132:0:5819:0:(genops.c:1385:class_connect()) connect: client 76f68b46-a017-4297-a662-44212e04e46d, cookie 0xb29fc47e1a291193 00000100:00080000:1.0:1788925156.464145:0:5819:0:(import.c:510:import_select_connection()) MGC192.168.203.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925156.464149:0:5819:0:(import.c:624:import_select_connection()) MGC192.168.203.104@tcp: import 0000000086f60f6c using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788925156.464200:0:5819:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dc6702db x1875823910977664/t0(0) o250->MGC192.168.203.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925156.464230:0:5819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 76f68b46-a017-4297-a662-44212e04e46d->MGS 00000020:01000004:1.0:1788925156.464250:0:5819:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788925156.464255:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788925156.464268:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c4004974) 00000020:00000080:1.0:1788925156.464280:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788925156.466942:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc6702db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:76f68b46-a017-4297-a662-44212e04e46d:3303:1875823910977664:0@lo:250: 00000100:00100000:0.0:1788925156.467024:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925156.467117:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910977664 00000100:00100000:0.0:1788925156.467124:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910977664 00000100:00100000:0.0:1788925156.467172:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925156.467179:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f567fa6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875823910977664:12345-0@lo:250: 00010000:00080000:0.0:1788925156.467219:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 76f68b46-a017-4297-a662-44212e04e46d@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:0.0:1788925156.467259:0:5831:0:(genops.c:1385:class_connect()) connect: client 76f68b46-a017-4297-a662-44212e04e46d, cookie 0xb29fc47e1a2911a1 00000100:00080000:0.0:1788925156.467390:0:5831:0:(import.c:65:import_set_state_nolock()) 00000000aeb450bb : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925156.467440:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f567fa6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+5:3303:x1875823910977664:12345-0@lo:250: Request processed in 261us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925156.467447:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925156.467481:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788925156.467489:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1788925156.467496:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788925156.467500:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788925156.467504:0:3303:0:(import.c:65:import_set_state_nolock()) 0000000086f60f6c MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788925156.467506:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788925156.467513:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788925156.467518:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc6702db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:76f68b46-a017-4297-a662-44212e04e46d:3303:1875823910977664:0@lo:250: 00000100:00100000:1.0:1788925156.475580:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788925156.478148:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788925156.478165:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788925156.480276:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788925156.480286:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788925156.480585:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788925156.480592:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788925156.485492:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788925156.486437:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788925156.486451:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788925156.487384:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788925156.487393:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788925156.539656:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788925156.542067:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788925156.542079:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788925156.559060:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788925156.559079:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788925156.566573:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788925156.567031:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788925156.567038:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788925156.567554:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788925156.567561:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788925156.573542:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925156.574025:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788925156.574033:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788925156.576483:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788925156.576495:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788925156.580149:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788925156.580337:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788925156.580343:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788925156.587516:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788925156.587532:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788925156.630373:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788925156.630606:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788925156.630612:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788925156.633212:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788925156.633226:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788925156.642454:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788925156.642541:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788925156.646269:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788925156.646297:0:5819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788925156.646302:0:5819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788925156.646428:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788925156.646461:0:5819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788925156.646466:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788925156.646468:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788925156.646469:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925156.646470:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925156.646471:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925156.646473:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925156.646474:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788925156.646475:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788925156.646476:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925156.646483:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925156.646484:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925156.646503:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788925156.646506:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788925156.646508:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788925156.646509:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788925156.646509:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925156.646510:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925156.646511:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925156.646513:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925156.646514:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788925156.646515:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788925156.646516:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788925156.646516:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788925156.646517:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925156.646518:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788925156.646552:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788925156.646568:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d796133b pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910977792:0@lo:253: 00000100:00100000:3.0:1788925156.646650:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925156.646703:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000002723380e going to sleep for 11 seconds 00000100:00100000:2.0:1788925156.647093:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910977792 00000100:00100000:2.0:1788925156.647110:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910977792 00000100:00100000:2.0:1788925156.647152:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925156.647160:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000375cbbe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+5:5819:x1875823910977792:12345-0@lo:253: 20000000:01000000:2.0:1788925156.647201:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788925156.647204:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788925156.647595:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788925156.647656:0:5833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788925156.648165:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925156.649274:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788925156.649486:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788925156.649491:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788925156.649496:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788925156.649499:0:5833:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788925156.649512:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788925156.650047:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788925156.650275:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788925156.650288:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788925156.650342:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788925156.650387:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788925156.650422:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788925156.650505:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788925156.650514:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788925156.650555:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788925156.650563:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788925156.650593:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788925156.650598:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788925156.650625:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788925156.660026:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788925156.660133:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788925156.660141:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788925156.660157:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925156.660425:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788925156.660438:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788925156.660482:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788925156.660513:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788925156.660585:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788925156.660598:0:5833:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788925156.660679:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788925156.660689:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788925156.660732:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788925156.660993:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788925156.661030:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788925156.661042:0:5833:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788925156.661141:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788925156.661150:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788925156.661182:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788925156.661214:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788925156.661368:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788925156.661411:0:5833:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788925156.661418:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788925156.662192:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788925156.662448:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788925156.662467:0:5833:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.104@tcp for mdt 20000000:01000000:3.0:1788925156.662469:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:3.0:1788925156.662502:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788925156.662509:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788925156.662534:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788925156.662541:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:3.0:1788925156.662583:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788925156.662593:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788925156.662622:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788925156.662655:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788925156.663010:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788925156.663014:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788925156.663019:0:5833:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788925156.663026:0:5833:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788925156.665442:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788925156.665611:0:5833:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788925156.684471:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788925156.684549:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1788925156.684627:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1788925156.684646:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788925156.684649:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788925156.684652:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788925156.684674:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788925156.684677:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788925156.684709:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788925156.684712:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788925156.692591:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788925156.692972:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788925156.693120:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788925156.694493:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1788925156.694523:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788925156.694526:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788925156.699442:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788925156.699798:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788925156.699846:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788925156.699873:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788925156.699887:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788925156.699889:0:5833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788925156.699895:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788925156.699912:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.699928:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.699937:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.699943:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.699948:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.699954:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.699959:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c574ce98 already unused, calling callback (000000004324b9cb) 00010000:00010000:0.0:1788925156.699963:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.699969:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.699978:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.699995:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.700001:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788925156.700015:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788925156.944140:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000375cbbe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+5:5819:x1875823910977792:12345-0@lo:253: Request processed in 296974us (297484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925156.944154:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925156.944244:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d796133b pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910977792:0@lo:253: 10000000:01000000:1.0:1788925156.944257:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788925156.944260:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788925156.944262:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788925156.944263:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925156.944264:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788925156.944265:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925156.944266:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925156.944268:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788925156.944269:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788925156.944270:0:5819:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788925156.944272:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925156.944273:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788925156.944289:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e4f96f7f from lustre-MDT0000 10000000:01000000:1.0:1788925156.944320:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788925156.944322:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788925156.944325:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e0d06a20000 10000000:01000000:1.0:1788925156.944329:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788925156.944336:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e0d06a20000 from 1 10000000:01000000:1.0:1788925156.944338:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788925156.944369:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000ea5e635a/0xb29fc47e1a2911af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925156.944379:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000ea5e635a/0xb29fc47e1a2911af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925156.944397:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000ea5e635a/0xb29fc47e1a2911af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925156.944670:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de32df69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910977920:0@lo:101: 00000100:00100000:2.0:1788925156.945019:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925156.945068:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f62e5af going to sleep for 11 seconds 00000100:00100000:0.0:1788925156.945124:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910977920 00000100:00100000:0.0:1788925156.945131:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910977920 00000100:00100000:0.0:1788925156.945165:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788925156.945173:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034681950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+5:5819:x1875823910977920:12345-0@lo:101: 00010000:00010000:0.0:1788925156.945184:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925156.945197:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2911af expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.945218:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2911af expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.945227:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c574ce98/0xb29fc47e1a2911b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2911af expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925156.945236:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c574ce98, rc 0) 00000100:00100000:0.0:1788925156.945273:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034681950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+6:5819:x1875823910977920:12345-0@lo:101: Request processed in 101us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925156.945280:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788925156.945352:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de32df69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910977920:0@lo:101: 00010000:00010000:2.0:1788925156.945365:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000ea5e635a/0xb29fc47e1a2911af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.945373:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000ea5e635a/0xb29fc47e1a2911af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925156.945490:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978048:0@lo:501: 00000100:00100000:2.0:1788925156.945514:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925156.945534:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000434607f3 going to sleep for 11 seconds 00000100:00100000:0.0:1788925156.945577:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910978048 00000100:00100000:0.0:1788925156.945580:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910978048 00000100:00100000:0.0:1788925156.945604:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788925156.945609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b802fc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+6:5819:x1875823910978048:12345-0@lo:501: 00000100:00100000:0.0:1788925156.946024:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b802fc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+6:5819:x1875823910978048:12345-0@lo:501: Request processed in 414us (509us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925156.946031:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788925156.946156:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978048:0@lo:501: 10000000:01000000:2.0:1788925156.946177:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788925156.946194:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000ea5e635a/0xb29fc47e1a2911af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.946201:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000ea5e635a/0xb29fc47e1a2911af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925156.946208:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0d1882f800 10000000:01000000:2.0:1788925156.946212:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788925156.946216:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e0d1882f800 10000000:01000000:2.0:1788925156.946218:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788925156.946221:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e0d1882f800 from 1 10000000:01000000:2.0:1788925156.946229:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788925156.946246:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 0000000048346fff/0xb29fc47e1a2911bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.946252:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 0000000048346fff/0xb29fc47e1a2911bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.946259:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 0000000048346fff/0xb29fc47e1a2911bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925156.946270:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978176:0@lo:101: 00000100:00100000:2.0:1788925156.946295:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925156.946324:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000434607f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788925156.946382:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910978176 00000100:00100000:1.0:1788925156.946386:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910978176 00000100:00100000:1.0:1788925156.946475:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788925156.946485:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f155fa62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+6:5819:x1875823910978176:12345-0@lo:101: 00010000:00010000:1.0:1788925156.946493:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925156.946503:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000998467a0/0xb29fc47e1a2911c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2911bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925156.946516:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000998467a0/0xb29fc47e1a2911c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2911bd expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925156.946524:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000998467a0/0xb29fc47e1a2911c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2911bd expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925156.946530:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000998467a0, rc 0) 00000100:00100000:1.0:1788925156.946567:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f155fa62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+7:5819:x1875823910978176:12345-0@lo:101: Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925156.946573:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925156.949583:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978176:0@lo:101: 00010000:00010000:2.0:1788925156.949610:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 0000000048346fff/0xb29fc47e1a2911bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2911c4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.949621:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 0000000048346fff/0xb29fc47e1a2911bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2911c4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925156.949640:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788925156.949644:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 0000000048346fff/0xb29fc47e1a2911bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2911c4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.949651:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 0000000048346fff/0xb29fc47e1a2911bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2911c4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925156.949669:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788925156.949677:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788925156.949683:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e0d1882f800 10000000:01000000:2.0:1788925156.950521:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788925156.950528:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788925156.950531:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788925156.950562:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000b1453770/0xb29fc47e1a2911cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.950570:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000b1453770/0xb29fc47e1a2911cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.950579:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000b1453770/0xb29fc47e1a2911cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925156.950597:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978304:0@lo:101: 00000100:00100000:2.0:1788925156.950667:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925156.950828:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000434607f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788925156.950923:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910978304 00000100:00100000:2.0:1788925156.950930:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910978304 00000100:00100000:2.0:1788925156.950970:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925156.950977:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dd4e405 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+7:5819:x1875823910978304:12345-0@lo:101: 00010000:00010000:2.0:1788925156.950988:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925156.951001:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008ad15075/0xb29fc47e1a2911d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2911cb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.951020:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ad15075/0xb29fc47e1a2911d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2911cb expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.951029:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008ad15075/0xb29fc47e1a2911d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2911cb expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.951037:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008ad15075, rc 0) 00000100:00100000:2.0:1788925156.951081:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dd4e405 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+8:5819:x1875823910978304:12345-0@lo:101: Request processed in 104us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925156.951086:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925156.951505:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978304:0@lo:101: 00010000:00010000:2.0:1788925156.951519:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000b1453770/0xb29fc47e1a2911cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925156.951526:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000b1453770/0xb29fc47e1a2911cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925156.951571:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978432:0@lo:501: 00000100:00100000:2.0:1788925156.951600:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925156.951627:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000434607f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788925156.951707:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910978432 00000100:00100000:1.0:1788925156.951712:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910978432 00000100:00100000:1.0:1788925156.951756:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788925156.951763:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018c50dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+8:5819:x1875823910978432:12345-0@lo:501: 00000100:00100000:1.0:1788925156.952170:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018c50dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+9:5819:x1875823910978432:12345-0@lo:501: Request processed in 407us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925156.952178:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788925156.952518:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978432:0@lo:501: 00000100:00100000:2.0:1788925156.952550:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978560:0@lo:503: 00000100:00100000:2.0:1788925156.952589:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925156.952620:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000434607f3 going to sleep for 11 seconds 00000100:00100000:0.0:1788925156.952687:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910978560 00000100:00100000:0.0:1788925156.952692:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910978560 00000100:00100000:0.0:1788925156.952909:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925156.952917:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfecedfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+9:5819:x1875823910978560:12345-0@lo:503: 00000100:00100000:0.0:1788925156.953058:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfecedfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+9:5819:x1875823910978560:12345-0@lo:503: Request processed in 142us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925156.953064:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788925156.953154:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978560:0@lo:503: 00000100:00100000:2.0:1788925156.971216:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:5861:1875823910978688:0@lo:502: 00000100:00100000:2.0:1788925156.971316:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925156.971383:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000434607f3 going to sleep for 11 seconds 00000100:00100000:0.0:1788925156.972089:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910978688 00000100:00100000:0.0:1788925156.972098:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910978688 00000100:00100000:0.0:1788925156.972159:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788925156.972168:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088036815 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+9:5861:x1875823910978688:12345-0@lo:502: 00000100:00100000:0.0:1788925156.972408:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088036815 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+9:5861:x1875823910978688:12345-0@lo:502: Request processed in 241us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925156.972424:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788925156.972532:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000062a9656c pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:5861:1875823910978688:0@lo:502: 00000020:01000000:1.0:1788925156.972562:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925156.972573:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925156.972575:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788925156.972581:0:5861:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788925156.972583:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788925156.972596:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000051ccdfb) 00000020:00000080:1.0:1788925156.972613:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788925156.972618:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788925156.972723:0:5861:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788925156.972730:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb29fc47e1a2911e0 00000020:00000080:1.0:1788925156.973176:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788925156.973182:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925156.973185:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925156.973187:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788925156.973190:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925156.973193:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925156.973194:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788925156.973198:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788925156.973205:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000144d9bd8) 00000020:00000080:1.0:1788925156.973221:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788925156.973226:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788925156.973227:0:5861:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788925156.973229:0:5861:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788925156.973235:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788925156.973297:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e4f96f7f from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788925156.973317:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007f8bcb66) 00000020:00000080:1.0:1788925156.973325:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788925156.973370:0:5861:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788925156.973375:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb29fc47e1a2911f5 00000020:00000080:1.0:1788925156.973456:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788925156.973462:0:5861:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788925156.973466:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb29fc47e1a2911fc 00080000:01000000:1.0:1788925156.973470:0:5861:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788925156.973473:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb29fc47e1a291203 00080000:10000000:3.0:1788925156.975315:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788925156.975640:0:5861:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788925156.987060:0:5861:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788925157.121351:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788925157.122095:0:5861:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788925157.125502:0:5861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788925157.125984:0:5861:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788925157.161137:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ee9b0ec8) 00000020:00000080:3.0:1788925157.161158:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788925157.161214:0:5861:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788925157.161219:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb29fc47e1a291211 00000020:00000080:3.0:1788925157.162538:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788925157.165846:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925157.280260:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925157.328460:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925157.365579:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925157.409551:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1788925157.443560:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788925157.473322:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788925157.528918:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb29fc47e1a291218 00000020:00000080:0.0:1788925157.529361:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788925157.529374:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925157.529381:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925157.529382:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788925157.529386:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925157.529392:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925157.529393:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788925157.529397:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788925157.529447:0:5861:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788925157.529469:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925157.529472:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925157.529479:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788925157.529482:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925157.529485:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925157.529486:0:5861:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788925157.529489:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788925157.529491:0:5861:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788925157.529545:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000810dd3ca pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:5861:1875823910978816:0@lo:502: 00000100:00100000:0.0:1788925157.529623:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925157.529690:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b292026 going to sleep for 11 seconds 00000100:00100000:1.0:1788925157.529873:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910978816 00000100:00100000:1.0:1788925157.529881:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910978816 00000100:00100000:1.0:1788925157.529925:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925157.529934:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063b1f374 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+9:5861:x1875823910978816:12345-0@lo:502: 00000100:00100000:1.0:1788925157.530311:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063b1f374 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+9:5861:x1875823910978816:12345-0@lo:502: Request processed in 378us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925157.530320:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788925157.530438:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000810dd3ca pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:5861:1875823910978816:0@lo:502: 00000020:01000000:3.0:1788925157.530464:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925157.530469:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925157.530470:0:5861:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788925157.530474:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788925157.530795:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788925157.530813:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788925157.530827:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000b1453770/0xb29fc47e1a2911cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.530838:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000b1453770/0xb29fc47e1a2911cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925157.530854:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e0d1882f800 from 1 10000000:01000000:1.0:1788925157.530857:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788925157.530893:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.530901:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.530910:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925157.530927:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b4c3fe4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978944:0@lo:101: 00000100:00100000:1.0:1788925157.530963:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925157.531000:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da12f074 going to sleep for 11 seconds 00000100:00100000:0.0:1788925157.531177:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910978944 00000100:00100000:0.0:1788925157.531183:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910978944 00000100:00100000:0.0:1788925157.531214:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788925157.531221:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c86aa5b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+9:5819:x1875823910978944:12345-0@lo:101: 00010000:00010000:0.0:1788925157.531230:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925157.531242:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29121f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925157.531260:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29121f expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925157.531270:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29121f expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925157.531277:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016b6b8a7, rc 0) 00000100:00100000:0.0:1788925157.531316:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c86aa5b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+10:5819:x1875823910978944:12345-0@lo:101: Request processed in 95us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925157.531321:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925157.532588:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b4c3fe4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910978944:0@lo:101: 00010000:00010000:3.0:1788925157.532615:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925157.532626:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925157.533249:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be0ebd78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979072:0@lo:256: 00000100:00100000:3.0:1788925157.533323:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925157.533356:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cda01339 going to sleep for 11 seconds 00000100:00100000:0.0:1788925157.534005:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910979072 00000100:00100000:0.0:1788925157.534014:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910979072 00000100:00100000:0.0:1788925157.534067:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788925157.534076:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005093c1df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+10:5819:x1875823910979072:12345-0@lo:256: 20000000:01000000:0.0:1788925157.534115:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788925157.534121:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788925157.534198:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005093c1df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+10:5819:x1875823910979072:12345-0@lo:256: Request processed in 124us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925157.534207:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925157.534794:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be0ebd78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979072:0@lo:256: 10000000:01000000:3.0:1788925157.536625:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788925157.536808:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925157.536822:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925157.536830:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d1882f800 from 1 10000000:01000000:3.0:1788925157.536833:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788925157.536872:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925157.536879:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925157.536888:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925157.536906:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be0ebd78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979200:0@lo:101: 00000100:00100000:3.0:1788925157.536968:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925157.537007:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cda01339 going to sleep for 11 seconds 00000100:00100000:2.0:1788925157.538177:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910979200 00000100:00100000:2.0:1788925157.538186:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910979200 00000100:00100000:2.0:1788925157.538251:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788925157.538263:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000047f0888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+10:5819:x1875823910979200:12345-0@lo:101: 00010000:00010000:2.0:1788925157.538277:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925157.538292:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29122d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.538314:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29122d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.538322:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29122d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.538330:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f121272, rc 0) 00000100:00100000:2.0:1788925157.538381:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000047f0888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+11:5819:x1875823910979200:12345-0@lo:101: Request processed in 123us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925157.538387:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925157.538823:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be0ebd78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979200:0@lo:101: 00010000:00010000:3.0:1788925157.538841:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925157.538850:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925157.538918:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be0ebd78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979328:0@lo:501: 00000100:00100000:3.0:1788925157.538952:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925157.539001:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cda01339 going to sleep for 11 seconds 00000100:00100000:2.0:1788925157.539094:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910979328 00000100:00100000:2.0:1788925157.539108:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910979328 00000100:00100000:2.0:1788925157.539143:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788925157.539150:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002affbfcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:5819:x1875823910979328:12345-0@lo:501: 00000100:00100000:2.0:1788925157.539651:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002affbfcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:5819:x1875823910979328:12345-0@lo:501: Request processed in 502us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925157.539776:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be0ebd78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979328:0@lo:501: 00000100:00100000:1.0:1788925157.539810:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db29306c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979456:0@lo:503: 00000100:00100000:1.0:1788925157.539847:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925157.539865:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7d3944b going to sleep for 11 seconds 00000100:00100000:2.0:1788925157.539997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788925157.540021:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910979456 00000100:00100000:2.0:1788925157.540026:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910979456 00000100:00100000:2.0:1788925157.540042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788925157.540047:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e422005a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:5819:x1875823910979456:12345-0@lo:503: 00000040:00080000:2.0:1788925157.540080:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788925157.540139:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e422005a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:5819:x1875823910979456:12345-0@lo:503: Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925157.540146:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788925157.540251:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db29306c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979456:0@lo:503: 00000040:00080000:3.0:1788925157.544925:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788925157.545491:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788925157.545514:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925157.545567:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.545580:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925157.545649:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788925157.545651:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0d1882f800 10000000:01000000:1.0:1788925157.545664:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0d1882f800 10000000:01000000:1.0:1788925157.545669:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788925157.545674:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e0d1882f800 from 1 10000000:01000000:1.0:1788925157.545677:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788925157.545710:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 0000000062afac4e/0xb29fc47e1a29123b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.545718:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 0000000062afac4e/0xb29fc47e1a29123b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.545728:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 0000000062afac4e/0xb29fc47e1a29123b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925157.545900:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db29306c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979584:0@lo:101: 00000100:00100000:1.0:1788925157.545966:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925157.546013:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c331a890 going to sleep for 11 seconds 00000100:00100000:2.0:1788925157.546073:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910979584 00000100:00100000:2.0:1788925157.546081:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910979584 00000100:00100000:2.0:1788925157.546138:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788925157.546146:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002886d9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:5819:x1875823910979584:12345-0@lo:101: 00010000:00010000:2.0:1788925157.546160:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925157.546170:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029159682/0xb29fc47e1a291242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29123b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.546190:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029159682/0xb29fc47e1a291242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29123b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.546201:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029159682/0xb29fc47e1a291242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29123b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.546209:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029159682, rc 0) 00000100:00100000:2.0:1788925157.546255:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002886d9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:5819:x1875823910979584:12345-0@lo:101: Request processed in 110us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925157.546263:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788925157.546373:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db29306c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979584:0@lo:101: 00010000:00010000:1.0:1788925157.546386:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 0000000062afac4e/0xb29fc47e1a29123b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.546394:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 0000000062afac4e/0xb29fc47e1a29123b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925157.546453:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db29306c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979712:0@lo:501: 00000100:00100000:1.0:1788925157.546479:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925157.546541:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c331a890 going to sleep for 11 seconds 00000100:00100000:3.0:1788925157.549130:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910979712 00000100:00100000:3.0:1788925157.549159:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910979712 00000100:00100000:3.0:1788925157.549212:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925157.549220:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6e8f0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:5819:x1875823910979712:12345-0@lo:501: 00000100:00100000:3.0:1788925157.549666:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6e8f0a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:5819:x1875823910979712:12345-0@lo:501: Request processed in 436us (3176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925157.549674:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788925157.551531:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db29306c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979712:0@lo:501: 00000100:00100000:1.0:1788925157.551589:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db29306c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979840:0@lo:503: 00000100:00100000:1.0:1788925157.552563:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925157.552684:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c331a890 going to sleep for 11 seconds 00000100:00100000:3.0:1788925157.555442:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910979840 00000100:00100000:3.0:1788925157.555457:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910979840 00000100:00100000:3.0:1788925157.555558:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925157.555568:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca107443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:5819:x1875823910979840:12345-0@lo:503: 00000100:00100000:3.0:1788925157.556028:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca107443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:5819:x1875823910979840:12345-0@lo:503: Request processed in 461us (3469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925157.556037:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788925157.556176:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db29306c pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910979840:0@lo:503: 00000100:00100000:1.0:1788925157.558890:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044859867 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:5866:1875823910979968:0@lo:502: 00000100:00100000:1.0:1788925157.558978:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925157.559042:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e0da74c2 going to sleep for 11 seconds 00000100:00100000:2.0:1788925157.559139:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910979968 00000100:00100000:2.0:1788925157.559147:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910979968 00000100:00100000:2.0:1788925157.559193:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925157.559201:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce142a84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:5866:x1875823910979968:12345-0@lo:502: 00000100:00100000:2.0:1788925157.559910:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce142a84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:5866:x1875823910979968:12345-0@lo:502: Request processed in 707us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925157.559920:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788925157.560357:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044859867 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:5866:1875823910979968:0@lo:502: 00000020:01000004:1.0:1788925157.560499:0:5866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788925157.560515:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c7e092e2) 00000020:00000080:1.0:1788925157.560534:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788925157.560624:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e4f96f7f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788925157.560628:0:5866:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e4f96f7f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788925157.560630:0:5866:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e4f96f7f 4 00010000:00080000:1.0:1788925157.560898:0:5866:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dc16c3f6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788925157.564350:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788925157.564644:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788925157.564688:0:5866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788925157.564699:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb29fc47e1a291250 00000100:00080000:1.0:1788925157.564708:0:5866:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925157.564712:0:5866:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000dc16c3f6 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788925157.564768:0:5866:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000044859867 x1875823910980096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925157.564791:0:5866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788925157.570563:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044859867 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875823910980096:0@lo:38: 00000100:00100000:0.0:1788925157.570682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925157.572326:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910980096 00000100:00100000:1.0:1788925157.572341:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910980096 00000100:00100000:1.0:1788925157.572432:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925157.572440:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c5751e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875823910980096:12345-0@lo:38: 00000100:00100000:1.0:1788925157.572531:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c5751e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875823910980096:12345-0@lo:38: Request processed in 90us (1850us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788925157.572539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925157.572617:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788925157.572643:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000dc16c3f6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925157.572648:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788925157.572651:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044859867 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875823910980096:0@lo:38: 00000100:00100000:1.0:1788925157.574035:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044859867 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:5866:1875823910980224:0@lo:502: 00000100:00100000:1.0:1788925157.574472:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925157.574549:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057a4ebda going to sleep for 11 seconds 00000100:00100000:0.0:1788925157.579628:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910980224 00000100:00100000:0.0:1788925157.579642:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910980224 00000100:00100000:1.0:1788925157.579843:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788925157.579853:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042f3f3a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:5866:x1875823910980224:12345-0@lo:502: 00000100:00100000:1.0:1788925157.580137:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042f3f3a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:5866:x1875823910980224:12345-0@lo:502: Request processed in 284us (6012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925157.580145:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925157.580393:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044859867 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:5866:1875823910980224:0@lo:502: 00000040:00080000:0.0:1788925157.580437:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788925157.580681:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788925157.580700:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788925157.580717:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 0000000062afac4e/0xb29fc47e1a29123b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.580728:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 0000000062afac4e/0xb29fc47e1a29123b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788925157.581339:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788925157.581342:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788925157.581347:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925157.581348:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925157.581349:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925157.581351:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925157.581352:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788925157.581353:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788925157.581354:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788925157.581355:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788925157.581357:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925157.581358:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788925157.581361:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788925157.581364:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788925157.581364:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788925157.581365:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925157.581366:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925157.581367:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925157.581368:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925157.581368:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788925157.581369:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788925157.581370:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788925157.581371:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788925157.581372:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925157.581373:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788925157.581395:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788925157.581419:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076c4196e pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910980352:0@lo:253: 00000100:00100000:1.0:1788925157.581507:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925157.581556:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7d3944b going to sleep for 11 seconds 00000100:00100000:3.0:1788925157.581681:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910980352 00000100:00100000:3.0:1788925157.581688:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910980352 00000100:00100000:3.0:1788925157.581731:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788925157.581739:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7ea2c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:5819:x1875823910980352:12345-0@lo:253: 20000000:01000000:3.0:1788925157.581794:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788925157.581807:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788925157.624595:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788925157.624629:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788925157.624697:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788925157.624701:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788925157.624720:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925157.624738:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29121f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925157.624758:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925157.624795:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a29121f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925157.624808:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a29121f expref: 12 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925157.624833:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037464b46 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875823910980480:0@lo:104: 00000100:00100000:0.0:1788925157.624897:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925157.624949:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023d31ffc going to sleep for 11 seconds 00000100:00100000:2.0:1788925157.626276:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910980480 00000100:00100000:2.0:1788925157.626289:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910980480 00000100:00100000:2.0:1788925157.626349:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788925157.626360:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a64748f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+3:5854:x1875823910980480:12345-0@lo:104: 00010000:00010000:2.0:1788925157.626378:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.626465:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788925157.626470:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a64748f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+3:5854:x1875823910980480:12345-0@lo:104: Request processed in 113us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925157.626476:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788925157.626498:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925157.626502:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.626509:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb804baa already unused, calling callback (00000000957b7d9c) 10000000:00010000:2.0:1788925157.626512:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.626519:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925157.626525:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925157.626530:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788925157.626561:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.626567:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925157.626593:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.626600:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000eb804baa/0xb29fc47e1a29121f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291226 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.626619:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925157.626621:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925157.626623:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925157.626735:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788925157.626787:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a493355 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823910980608:0@lo:103: 00000100:00100000:2.0:1788925157.626826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925157.627024:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037464b46 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875823910980480:0@lo:104: 00010000:00010000:3.0:1788925157.627045:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925157.627370:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910980608 00000100:00100000:1.0:1788925157.627376:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910980608 00010000:00010000:1.0:1788925157.627394:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29121f expref: 13 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925157.627423:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925157.627429:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000653263b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+13:3304:x1875823910980608:12345-0@lo:103: 00010000:00010000:1.0:1788925157.627439:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925157.627444:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29121f expref: 13 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627459:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a29121f expref: 13 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627472:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000016b6b8a7/0xb29fc47e1a291226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a29121f expref: 13 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627484:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627491:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788925157.627505:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002804263s 00010000:00010000:1.0:1788925157.627508:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627514:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627519:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627524:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627529:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000302e5409 already unused, calling callback (000000004324b9cb) 00010000:00010000:1.0:1788925157.627532:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627539:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627563:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925157.627572:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925157.627612:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000653263b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+12:3304:x1875823910980608:12345-0@lo:103: Request processed in 184us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925157.627619:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925157.627643:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a493355 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823910980608:0@lo:103: 00010000:00010000:2.0:1788925157.627828:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.627835:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925157.627840:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000302e5409/0xb29fc47e1a291257 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925157.634465:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7ea2c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+11:5819:x1875823910980352:12345-0@lo:253: Request processed in 52720us (52951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925157.634481:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788925157.634603:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076c4196e pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:5819:1875823910980352:0@lo:253: 10000000:01000000:0.0:1788925157.634620:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788925157.634624:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788925157.634625:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788925157.634627:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925157.634628:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925157.634629:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925157.634630:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925157.634631:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788925157.634633:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788925157.634634:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788925157.634635:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788925157.634637:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925157.634638:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788925157.634713:0:5819:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788925157.642523:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925157.643034:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788925157.643331:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925157.643502:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788925157.643865:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925157.644047:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788925157.644934:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925157.645225:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788925157.645435:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925157.645608:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788925157.645966:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925157.646222:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788925157.681588:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788925157.717393:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788925157.717833:0:5872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1788925157.720954:0:5871:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788925157.720961:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788925157.722802:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788925157.723027:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788925157.723719:0:5819:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788925157.723878:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788925157.724043:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925157.725177:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788925157.725710:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788925157.725740:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788925157.725996:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788925157.726187:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788925157.729395:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788925157.729722:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788925157.730311:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788925157.730516:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788925157.730888:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788925157.731041:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788925157.731358:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788925157.731589:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788925157.731992:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788925157.732277:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788925157.732457:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788925157.732596:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788925157.733022:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788925157.733318:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788925157.733483:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788925157.733631:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788925157.734359:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788925157.734569:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788925157.734980:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788925157.735139:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788925157.735295:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788925157.735451:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788925157.735595:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788925157.735787:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788925157.735934:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788925157.736066:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788925157.736234:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788925157.736376:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788925157.736516:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788925157.736662:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788925157.736849:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788925157.736982:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788925157.737707:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788925157.805930:0:5872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788925157.863980:0:5819:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788925157.864019:0:5819:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9f641d8f988 00100000:10000000:0.0:1788925157.864027:0:5819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788925157.869065:0:5819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788925157.869087:0:5819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788925157.869117:0:5819:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788925157.869215:0:5819:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788925157.919137:0:5872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788925157.919209:0:5872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788925157.919215:0:5872:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788925158.466384:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925159.489971:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925160.521648:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925161.543366:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925162.336211:0:6115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788925162.564792:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788925163.073084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788925163.073096:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788925163.073112:0:36:0:(import.c:65:import_set_state_nolock()) 00000000dc16c3f6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925163.073126:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000dc16c3f6 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:2.0:1788925163.073148:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003e4cdccb x1875823910980864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788925163.073308:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e4cdccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875823910980864:0@lo:38: 00000100:00100000:3.0:1788925163.073380:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925163.073511:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910980864 00000100:00100000:2.0:1788925163.073518:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910980864 00000100:00100000:2.0:1788925163.073557:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925163.073564:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ef2382a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875823910980864:12345-0@lo:38: 00010000:00080000:2.0:1788925163.073589:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1788925163.073622:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb29fc47e1a29125e 00000004:00100000:2.0:1788925163.073661:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788925163.073814:0:5840:0:(import.c:65:import_set_state_nolock()) 000000003c2671f0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925163.073865:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ef2382a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875823910980864:12345-0@lo:38: Request processed in 300us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925163.073872:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788925163.074018:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003e4cdccb x1875823910980864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788925163.074031:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788925163.074037:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788925163.074040:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788925163.074042:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000dc16c3f6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788925163.074047:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e4cdccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875823910980864:0@lo:38: 00000100:00100000:1.0:1788925163.074238:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2144933 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910980736:0@lo:400: 00000100:00100000:1.0:1788925163.074274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925163.074418:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910980736 00000100:00100000:3.0:1788925163.074423:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910980736 00000100:00100000:3.0:1788925163.074459:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788925163.074465:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ac6ada5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+11:3306:x1875823910980736:12345-0@lo:400: 00000100:00100000:3.0:1788925163.074512:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ac6ada5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+11:3306:x1875823910980736:12345-0@lo:400: Request processed in 47us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925163.074519:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788925163.074989:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2144933 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910980736:0@lo:400: 00010000:00010000:0.0:1788925163.584982:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925164.609130:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925165.639040:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788925165.639625:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788925165.639630:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e0d1882f800 from 3 10000000:01000000:1.0:1788925165.639635:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788925165.639695:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 00000000002ee822/0xb29fc47e1a291265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925165.639707:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 00000000002ee822/0xb29fc47e1a291265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925165.639717:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 00000000002ee822/0xb29fc47e1a291265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925165.639740:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054c53158 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910980992:0@lo:101: 00000100:00100000:1.0:1788925165.639843:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925165.639894:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000489dabc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925165.641978:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910980992 00000100:00100000:2.0:1788925165.641993:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910980992 00000100:00100000:2.0:1788925165.642063:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788925165.642072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af0718df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+11:5836:x1875823910980992:12345-0@lo:101: 00010000:00010000:2.0:1788925165.642088:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925165.642105:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f347ea2/0xb29fc47e1a29126c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291265 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925165.642130:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f347ea2/0xb29fc47e1a29126c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291265 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925165.642168:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f347ea2/0xb29fc47e1a29126c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291265 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925165.642177:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f347ea2, rc 0) 00000100:00100000:2.0:1788925165.642248:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af0718df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823910980992:12345-0@lo:101: Request processed in 177us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925165.642255:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788925165.642876:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054c53158 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910980992:0@lo:101: 00010000:00010000:1.0:1788925165.642896:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 00000000002ee822/0xb29fc47e1a291265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925165.642905:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 00000000002ee822/0xb29fc47e1a291265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925165.642969:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054c53158 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910981120:0@lo:256: 00000100:00100000:1.0:1788925165.643010:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925165.643045:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000489dabc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925165.644376:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910981120 00000100:00100000:2.0:1788925165.644388:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910981120 00000100:00100000:2.0:1788925165.644435:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788925165.644442:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000202306f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823910981120:12345-0@lo:256: 20000000:01000000:2.0:1788925165.644461:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788925165.644484:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788925165.644487:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788925165.644631:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000202306f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823910981120:12345-0@lo:256: Request processed in 189us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925165.644639:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788925165.645144:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054c53158 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910981120:0@lo:256: 10000000:01000000:1.0:1788925165.645204:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788925165.645212:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: 00000000002ee822/0xb29fc47e1a291265 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925165.645223:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: 00000000002ee822/0xb29fc47e1a291265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925166.658767:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788925167.407264:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfff01280 20000000:00000080:1.0:1788925167.407283:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e0d11e32c00 uarg=0000000000000000 20000000:01000000:1.0:1788925167.407319:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788925167.407327:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788925167.407331:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788925167.407610:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788925167.407623:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788925167.413322:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788925167.413869:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788925167.414002:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788925167.414082:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788925167.414102:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788925167.414190:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.414209:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29122d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.414216:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.414262:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a29122d expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.414276:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a29122d expref: 11 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925167.414290:0:6316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2144933 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1875823910981248:0@lo:104: 00000100:00100000:2.0:1788925167.414352:0:6316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925167.414428:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910981248 00000100:00100000:1.0:1788925167.414437:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910981248 00000100:00100000:1.0:1788925167.414493:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925167.414502:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000123a8e7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:6316:x1875823910981248:12345-0@lo:104: 00010000:00010000:1.0:1788925167.414513:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925167.414575:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788925167.414578:0:6316:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b39cb31b going to sleep for 11 seconds 00000100:00100000:1.0:1788925167.414582:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000123a8e7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:6316:x1875823910981248:12345-0@lo:104: Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925167.414591:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925167.414605:0:6316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2144933 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1875823910981248:0@lo:104: 00010000:00010000:2.0:1788925167.414621:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925167.414812:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925167.414818:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925167.414838:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1cd8a9b already unused, calling callback (00000000957b7d9c) 10000000:00010000:1.0:1788925167.414841:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925167.414849:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925167.414855:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925167.414861:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788925167.414895:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925167.414902:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788925167.414919:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925167.414925:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: 00000000f1cd8a9b/0xb29fc47e1a29122d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291234 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925167.414940:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925167.414942:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925167.414943:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925167.415225:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925167.415238:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054c53158 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910981376:0@lo:103: 00000100:00100000:1.0:1788925167.415271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925167.418080:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910981376 00000100:00100000:1.0:1788925167.418096:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910981376 00010000:00010000:2.0:1788925167.422659:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29122d expref: 12 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925167.422713:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925167.422724:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f2c64a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+12:3306:x1875823910981376:12345-0@lo:103: 00010000:00010000:2.0:1788925167.422739:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925167.423211:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29122d expref: 12 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423224:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a29122d expref: 12 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423243:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f121272/0xb29fc47e1a291234 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a29122d expref: 12 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423278:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423286:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423301:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423307:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423313:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423318:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423324:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b0794668 already unused, calling callback (000000004324b9cb) 00010000:00010000:2.0:1788925167.423328:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.423334:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925167.430696:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925167.430714:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.436432:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.436452:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b0794668/0xb29fc47e1a291273 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925167.436629:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925167.437297:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f2c64a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+11:3306:x1875823910981376:12345-0@lo:103: Request processed in 14571us (22021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925167.437315:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925167.437412:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054c53158 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910981376:0@lo:103: 00010000:00010000:3.0:1788925167.681016:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925168.193063:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dec92a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823910981504:0@lo:400: 00000100:00100000:2.0:1788925168.193142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925168.193207:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788925168.193213:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4dc66eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823910981632:0@lo:400: 00000100:00100000:2.0:1788925168.193244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925168.193325:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910981632 00000100:00100000:1.0:1788925168.193335:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910981632 00000100:00100000:1.0:1788925168.193381:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925168.193389:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2144933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823910981632:12345-0@lo:400: 00000100:00100000:1.0:1788925168.193446:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2144933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823910981632:12345-0@lo:400: Request processed in 59us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925168.193453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788925168.193493:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d4dc66eb x1875823910981632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925168.193510:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4dc66eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823910981632:0@lo:400: 00000100:00100000:0.0:1788925168.193926:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910981504 00000100:00100000:0.0:1788925168.193931:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910981504 00000100:00100000:0.0:1788925168.193965:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925168.193971:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0156894 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+11:3304:x1875823910981504:12345-0@lo:400: 00000100:00100000:0.0:1788925168.194004:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0156894 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+11:3304:x1875823910981504:12345-0@lo:400: Request processed in 34us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925168.194010:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788925168.194303:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dec92a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823910981504:0@lo:400: 00010000:00010000:0.0:1788925168.705416:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925169.734201:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925170.754929:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925171.777942:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925172.805409:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925173.325643:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925173.325665:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fbf5f3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910981760:0@lo:400: 00000100:00100000:3.0:1788925173.325733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925173.325819:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000029d191a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823910981888:0@lo:400: 00000100:00100000:3.0:1788925173.325846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925173.325882:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910981888 00000100:00100000:3.0:1788925173.325889:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910981888 00000100:00100000:3.0:1788925173.325931:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925173.325939:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ef2f6d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823910981888:12345-0@lo:400: 00000100:00100000:3.0:1788925173.325986:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ef2f6d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823910981888:12345-0@lo:400: Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925173.325993:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788925173.326037:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000029d191a2 x1875823910981888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925173.326050:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000029d191a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823910981888:0@lo:400: 00000100:00100000:2.0:1788925173.326169:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910981760 00000100:00100000:2.0:1788925173.326173:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910981760 00000100:00100000:2.0:1788925173.326201:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788925173.326207:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000105363a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:3307:x1875823910981760:12345-0@lo:400: 00000100:00100000:2.0:1788925173.326245:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000105363a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:3307:x1875823910981760:12345-0@lo:400: Request processed in 38us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925173.326251:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788925173.326310:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fbf5f3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910981760:0@lo:400: 10000000:01000000:2.0:1788925173.825152:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788925173.825160:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d1882f800 from 1 10000000:01000000:2.0:1788925173.825165:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788925173.825204:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: 000000006f121272/0xb29fc47e1a29127a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925173.825217:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: 000000006f121272/0xb29fc47e1a29127a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925173.825229:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: 000000006f121272/0xb29fc47e1a29127a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925173.825269:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009421999 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910982016:0@lo:101: 00000100:00100000:2.0:1788925173.825332:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925173.825371:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098b89277 going to sleep for 11 seconds 00000100:00100000:2.0:1788925173.825415:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910982016 00000100:00100000:2.0:1788925173.825422:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910982016 00000100:00100000:2.0:1788925173.825460:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788925173.825468:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000024e863 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+11:5836:x1875823910982016:12345-0@lo:101: 00010000:00010000:2.0:1788925173.825481:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925173.825491:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007b7ff75/0xb29fc47e1a291281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29127a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925173.825510:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007b7ff75/0xb29fc47e1a291281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29127a expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925173.825519:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007b7ff75/0xb29fc47e1a291281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29127a expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925173.825528:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007b7ff75, rc 0) 00000100:00100000:2.0:1788925173.825583:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000024e863 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823910982016:12345-0@lo:101: Request processed in 116us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925173.825590:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788925173.825615:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925173.829889:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009421999 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910982016:0@lo:101: 00010000:00010000:1.0:1788925173.829918:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: 000000006f121272/0xb29fc47e1a29127a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925173.829929:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: 000000006f121272/0xb29fc47e1a29127a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925173.830011:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dec92a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910982144:0@lo:501: 00000100:00100000:1.0:1788925173.830077:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925173.830117:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003a8e087 going to sleep for 11 seconds 00000100:00100000:1.0:1788925173.830135:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910982144 00000100:00100000:1.0:1788925173.830140:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910982144 00000100:00100000:1.0:1788925173.830177:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788925173.830184:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b5715a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823910982144:12345-0@lo:501: 00000100:00100000:1.0:1788925173.830481:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b5715a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823910982144:12345-0@lo:501: Request processed in 297us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925173.830496:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788925173.830537:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dec92a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910982144:0@lo:501: 00000100:00100000:1.0:1788925173.830563:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dec92a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910982272:0@lo:503: 00000100:00100000:1.0:1788925173.830598:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925173.830613:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003a8e087 going to sleep for 11 seconds 00000100:00100000:1.0:1788925173.830625:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910982272 00000100:00100000:1.0:1788925173.830628:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910982272 00000100:00100000:1.0:1788925173.830649:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788925173.830655:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a21c4c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823910982272:12345-0@lo:503: 00000100:00100000:1.0:1788925173.830986:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a21c4c3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823910982272:12345-0@lo:503: Request processed in 330us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925173.830994:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788925173.831044:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dec92a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910982272:0@lo:503: 00000100:00100000:1.0:1788925173.831245:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dec92a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:6675:1875823910982400:0@lo:502: 00000100:00100000:1.0:1788925173.831277:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925173.831298:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910982400 00000100:00100000:1.0:1788925173.831302:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910982400 00000100:00100000:1.0:1788925173.831324:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788925173.831329:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e70dde35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:6675:x1875823910982400:12345-0@lo:502: 00000100:00100000:1.0:1788925173.831463:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e70dde35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:6675:x1875823910982400:12345-0@lo:502: Request processed in 134us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925173.831469:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788925173.831498:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082b24d74 going to sleep for 11 seconds 00000100:00100000:1.0:1788925173.831511:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dec92a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:6675:1875823910982400:0@lo:502: 00000020:01000000:1.0:1788925173.831538:0:6675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925173.831547:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925173.831550:0:6675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788925173.831556:0:6675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0d1882f800 00000020:00000080:1.0:1788925173.831559:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788925173.831594:0:6675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:6675:1875823910982528:0@lo:502: 00000100:00100000:1.0:1788925173.831623:0:6675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925173.831642:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910982528 00000100:00100000:1.0:1788925173.831646:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910982528 00000100:00100000:1.0:1788925173.831664:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788925173.831670:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:6675:x1875823910982528:12345-0@lo:502: 00000100:00100000:1.0:1788925173.837496:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:6675:x1875823910982528:12345-0@lo:502: Request processed in 5815us (5862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925173.837509:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788925173.837683:0:6675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1851b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788925173.837708:0:6675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:6675:1875823910982528:0@lo:502: 00000020:01000000:1.0:1788925173.837811:0:6675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925173.837819:0:6675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925173.837821:0:6675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788925173.837826:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788925173.838009:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788925173.838027:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925173.838037:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925173.838048:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788925173.853813:0:6673:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788925173.853817:0:6673:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788925173.853950:0:6673:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e0d04b8b800 00000020:01000004:1.0:1788925173.853966:0:6673:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788925173.853978:0:6673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788925173.853991:0:6673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e0d3b1499b8) 00000020:00000080:1.0:1788925173.854019:0:6673:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788925173.898821:0:6673:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788925173.899085:0:6673:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788925173.945627:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788925173.955901:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788925173.955938:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788925173.955995:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788925173.956050:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788925173.956382:0:6673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788925173.957620:0:6673:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788925173.957635:0:6673:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb29fc47e1a29128f 00000020:01000004:2.0:1788925173.957644:0:6673:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788925173.957667:0:6673:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788925173.957671:0:6673:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788925173.957679:0:6673:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788925173.957870:0:6673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788925173.957889:0:6673:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e0d10583370) 00000020:00000080:2.0:1788925173.957903:0:6673:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788925173.959184:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925173.959349:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788925173.959355:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788925173.965251:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788925173.965262:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788925173.966855:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788925173.966866:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788925173.972197:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925173.975214:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788925173.975226:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788925173.989739:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788925173.989774:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788925174.039481:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788925174.039859:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788925174.039866:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788925174.041372:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788925174.041500:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788925174.043320:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788925174.043332:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788925174.046538:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788925174.050495:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788925174.050508:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788925174.066464:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788925174.069320:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788925174.177675:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925174.178509:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788925174.178517:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788925174.188189:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788925174.188205:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788925174.188888:0:6673:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788925174.188913:0:6673:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788925174.188920:0:6673:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788925174.216137:0:6673:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788925174.216176:0:6673:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.104@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788925174.216180:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788925174.216181:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788925174.216183:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925174.216184:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925174.216186:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925174.216187:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925174.216188:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925174.216194:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925174.216196:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925174.216197:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925174.216199:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788925174.216202:0:6673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788925174.216204:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788925174.216205:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788925174.216206:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925174.216207:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925174.216208:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925174.216209:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925174.216210:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925174.216211:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925174.216212:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925174.216213:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925174.216213:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788925174.216249:0:6673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788925174.216268:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910982656:0@lo:253: 00000100:00100000:2.0:1788925174.216336:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925174.216401:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10467900 going to sleep for 11 seconds 00000100:00100000:1.0:1788925174.216557:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910982656 00000100:00100000:1.0:1788925174.216566:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910982656 00000100:00100000:1.0:1788925174.216626:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788925174.216636:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910982656:12345-0@lo:253: 20000000:01000000:1.0:1788925174.216664:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788925174.216669:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788925174.216674:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788925174.216677:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788925174.218255:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925174.218567:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788925174.218582:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788925174.218620:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788925174.218628:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788925174.219635:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788925174.225382:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788925174.231300:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788925174.231494:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1788925174.231498:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788925174.231545:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788925174.231555:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788925174.231612:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788925174.231622:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1788925174.231655:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788925174.231664:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788925174.231696:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788925174.231777:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788925174.233143:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788925174.233167:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:0.0:1788925174.233169:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:0.0:1788925174.233207:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788925174.233371:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788925174.233485:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788925174.233493:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:0.0:1788925174.233539:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788925174.233550:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788925174.233583:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788925174.233616:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788925174.233648:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788925174.233651:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788925174.233655:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788925174.233666:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788925174.233668:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788925174.233701:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788925174.233704:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788925174.238386:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788925174.239091:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788925174.239158:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788925174.239903:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788925174.239949:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788925174.240154:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788925174.240171:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788925174.240174:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788925174.242701:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788925174.242825:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788925174.242881:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788925174.243321:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788925174.243370:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788925174.243425:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788925174.243439:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788925174.243442:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788925174.247948:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788925174.248989:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788925174.249053:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788925174.249128:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788925174.249158:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788925174.249161:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788925174.249171:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788925174.249190:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.249209:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d00030c00/0xb29fc47e1a2911b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2911af expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.249228:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2911d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2911cb expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.249234:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a291242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29123b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.249242:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.249281:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a291242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a29123b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.249296:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a291242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a29123b expref: 12 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925174.249311:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1875823910982784:0@lo:104: 00000100:00100000:1.0:1788925174.249375:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925174.249607:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2911d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2911cb expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.249617:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2911d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2911cb expref: 12 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925174.249637:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1875823910982912:0@lo:104: 00000100:00100000:1.0:1788925174.249660:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925174.249692:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d00030c00/0xb29fc47e1a2911b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2911af expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.249701:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d00030c00/0xb29fc47e1a2911b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2911af expref: 12 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925174.249709:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1875823910983040:0@lo:104: 00000100:00100000:1.0:1788925174.249729:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925174.249740:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d0ab2ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925174.249854:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910982784 00000100:00100000:2.0:1788925174.249861:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910982784 00000100:00100000:2.0:1788925174.249898:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910982912 00000100:00100000:2.0:1788925174.249900:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910982912 00000100:00100000:2.0:1788925174.249908:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910983040 00000100:00100000:2.0:1788925174.249910:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910983040 00000100:00100000:2.0:1788925174.249921:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788925174.249930:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+5:5832:x1875823910982784:12345-0@lo:104: 00010000:00010000:2.0:1788925174.249952:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29123b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250017:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788925174.250023:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+5:5832:x1875823910982784:12345-0@lo:104: Request processed in 94us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.250029:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788925174.250054:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788925174.250059:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+4:5832:x1875823910982912:12345-0@lo:104: 00010000:00010000:2.0:1788925174.250065:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2911cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250098:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788925174.250103:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+4:5832:x1875823910982912:12345-0@lo:104: Request processed in 45us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.250109:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788925174.250121:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925174.250127:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:5832:x1875823910983040:12345-0@lo:104: 00010000:00010000:2.0:1788925174.250134:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d0148ae00/0xb29fc47e1a2911af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250160:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788925174.250164:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:5832:x1875823910983040:12345-0@lo:104: Request processed in 38us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.250170:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788925174.250185:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788925174.250189:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29123b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250196:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148a400 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:2.0:1788925174.250200:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29123b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250208:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29123b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925174.250226:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29123b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925174.250232:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788925174.250258:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29123b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250265:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925174.250278:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29123b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250284:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29123b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291242 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250297:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788925174.250306:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2911cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250312:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044000 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:2.0:1788925174.250315:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2911cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250321:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2911cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925174.250328:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2911cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925174.250333:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788925174.250352:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2911cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250358:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925174.250363:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2911cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250368:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2911cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2911d2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250376:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925174.250379:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d0148ae00/0xb29fc47e1a2911af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250502:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148ae00 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:2.0:1788925174.250506:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148ae00/0xb29fc47e1a2911af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250512:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d0148ae00/0xb29fc47e1a2911af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925174.250518:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148ae00/0xb29fc47e1a2911af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925174.250523:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788925174.250538:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d0148ae00/0xb29fc47e1a2911af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250543:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925174.250557:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148ae00/0xb29fc47e1a2911af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250577:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d0148ae00/0xb29fc47e1a2911af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2911b6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.250606:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925174.250608:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925174.250609:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925174.250624:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910983424:0@lo:103: 00000100:00100000:2.0:1788925174.250664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925174.250779:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925174.250804:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910983424 00000100:00100000:0.0:1788925174.250809:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910983424 00010000:00010000:0.0:1788925174.250829:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d00030c00/0xb29fc47e1a2911b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2911af expref: 13 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925174.250849:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788925174.250856:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+13:3306:x1875823910983424:12345-0@lo:103: 00010000:00010000:0.0:1788925174.250865:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925174.250870:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d00030c00/0xb29fc47e1a2911b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2911af expref: 13 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.250879:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d00030c00/0xb29fc47e1a2911b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2911af expref: 13 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.250894:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925174.250926:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+13:3306:x1875823910983424:12345-0@lo:103: Request processed in 71us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925174.250951:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788925174.250984:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910983424:0@lo:103: 00000100:00100000:1.0:1788925174.251113:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823910983168:0@lo:103: 00000100:00100000:1.0:1788925174.251142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925174.251179:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925174.251185:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823910983296:0@lo:103: 00000100:00100000:1.0:1788925174.251208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925174.251238:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1875823910982784:0@lo:104: 00000100:00100000:1.0:1788925174.251246:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1875823910982912:0@lo:104: 00010000:00010000:1.0:1788925174.251254:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d00030c00/0xb29fc47e1a2911b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2911af expref: 12 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925174.251264:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5832:1875823910983040:0@lo:104: 00010000:00010000:1.0:1788925174.251285:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925174.251548:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910983168 00000100:00100000:3.0:1788925174.251554:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910983168 00010000:00010000:3.0:1788925174.251576:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a291242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29123b expref: 12 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925174.251600:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910983296 00000100:00100000:3.0:1788925174.251603:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910983296 00010000:00010000:3.0:1788925174.251615:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2911d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2911cb expref: 13 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925174.251626:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925174.251632:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+13:3304:x1875823910983168:12345-0@lo:103: 00010000:00010000:3.0:1788925174.251639:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925174.251644:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a291242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29123b expref: 13 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251653:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a291242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a29123b expref: 13 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251664:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a291242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a29123b expref: 13 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251676:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925174.251707:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+12:3304:x1875823910983168:12345-0@lo:103: Request processed in 75us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.251713:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925174.251726:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788925174.251732:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+11:3304:x1875823910983296:12345-0@lo:103: 00010000:00010000:3.0:1788925174.251739:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925174.251767:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2911d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2911cb expref: 11 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251776:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2911d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2911cb expref: 11 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251793:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2911d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2911cb expref: 11 pid: 5832 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251804:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251812:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251826:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251833:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251840:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251846:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251851:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148b800 already unused, calling callback (ffffffffc141f230) 00010000:00010000:3.0:1788925174.251855:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251862:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251879:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.251900:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925174.251925:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+10:3304:x1875823910983296:12345-0@lo:103: Request processed in 194us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.251932:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788925174.252078:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823910983296:0@lo:103: 00000100:00100000:1.0:1788925174.252095:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823910983168:0@lo:103: 00010000:00010000:2.0:1788925174.252172:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.252180:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.252186:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a29129d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788925174.252199:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788925174.352729:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+9:6673:x1875823910982656:12345-0@lo:253: Request processed in 136086us (136384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.352768:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788925174.358322:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910982656:0@lo:253: 10000000:01000000:2.0:1788925174.358342:0:6673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788925174.358346:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788925174.358347:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788925174.358349:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925174.358350:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788925174.358352:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925174.358354:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925174.358356:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925174.358358:0:6673:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788925174.358360:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925174.358361:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788925174.358544:0:6673:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0d04b8b800 from lustre-OST0000 10000000:01000000:0.0:1788925174.358580:0:6673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788925174.358583:0:6673:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788925174.358592:0:6673:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e0d06a20000 local copy 10000000:01000000:0.0:1788925174.358596:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788925174.358635:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.358646:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.358656:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925174.358674:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910983552:0@lo:101: 00000100:00100000:0.0:1788925174.358733:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.358825:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d35003240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925174.358943:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910983552 00000100:00100000:1.0:1788925174.358950:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910983552 00000100:00100000:1.0:1788925174.358990:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788925174.359010:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+9:6673:x1875823910983552:12345-0@lo:101: 00010000:00010000:1.0:1788925174.359024:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925174.359036:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d0148ac00/0xb29fc47e1a2912ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2912a4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.359057:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d0148ac00/0xb29fc47e1a2912ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2912a4 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.359066:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d0148ac00/0xb29fc47e1a2912ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2912a4 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.359074:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148ac00, rc 0) 00000100:00100000:1.0:1788925174.359130:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+10:6673:x1875823910983552:12345-0@lo:101: Request processed in 132us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925174.359137:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788925174.359297:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910983552:0@lo:101: 00010000:00010000:0.0:1788925174.359309:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.359317:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925174.359439:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910983680:0@lo:501: 00000100:00100000:0.0:1788925174.359465:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.359498:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d35003240 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.359673:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910983680 00000100:00100000:3.0:1788925174.359677:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910983680 00000100:00100000:3.0:1788925174.359712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788925174.359721:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+10:6673:x1875823910983680:12345-0@lo:501: 00000100:00100000:3.0:1788925174.359948:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+10:6673:x1875823910983680:12345-0@lo:501: Request processed in 228us (481us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925174.359955:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788925174.360071:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910983680:0@lo:501: 10000000:01000000:0.0:1788925174.360084:0:6673:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788925174.360109:0:6673:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788925174.360115:0:6673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.360124:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.360132:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.360154:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788925174.360173:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0d04b8b800 10000000:01000000:0.0:1788925174.360177:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788925174.360181:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e0d06a20000 10000000:01000000:0.0:1788925174.360184:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788925174.360187:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e0d06a20000 from 1 10000000:01000000:0.0:1788925174.360190:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788925174.360208:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00031400/0xb29fc47e1a2912b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.360217:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d00031400/0xb29fc47e1a2912b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.360225:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00031400/0xb29fc47e1a2912b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925174.360238:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910983808:0@lo:101: 00000100:00100000:0.0:1788925174.360268:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.360334:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350039c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788925174.360392:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925174.360399:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.360407:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00031800 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:2.0:1788925174.360411:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.360420:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925174.360428:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925174.360434:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788925174.360452:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.360458:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925174.360485:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.360493:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d00031800/0xb29fc47e1a2912a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb29fc47e1a2912ab expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.360509:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925174.360511:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925174.360513:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925174.360568:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910983936:0@lo:103: 00000100:00100000:3.0:1788925174.360595:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925174.360713:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910983936 00000100:00100000:2.0:1788925174.360717:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910983936 00000100:00100000:2.0:1788925174.360789:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788925174.360797:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+10:3307:x1875823910983936:12345-0@lo:103: 00010000:00010000:2.0:1788925174.360814:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925174.360827:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d0148ac00/0xb29fc47e1a2912ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb29fc47e1a2912a4 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.360843:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925174.360875:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+9:3307:x1875823910983936:12345-0@lo:103: Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.360883:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788925174.360924:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910983936:0@lo:103: 00000100:00100000:1.0:1788925174.362536:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910983808 00000100:00100000:1.0:1788925174.362547:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910983808 00000100:00100000:1.0:1788925174.362908:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788925174.362922:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+9:6673:x1875823910983808:12345-0@lo:101: 00010000:00010000:1.0:1788925174.362939:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925174.362956:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d0148b600/0xb29fc47e1a2912b9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2912b2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.362980:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d0148b600/0xb29fc47e1a2912b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2912b2 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.363016:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d0148b600/0xb29fc47e1a2912b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2912b2 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.363025:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148b600, rc 0) 00000100:00100000:1.0:1788925174.363109:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+10:6673:x1875823910983808:12345-0@lo:101: Request processed in 190us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925174.363116:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788925174.363207:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910983808:0@lo:101: 00010000:00010000:0.0:1788925174.363225:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00031400/0xb29fc47e1a2912b2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.363236:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00031400/0xb29fc47e1a2912b2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2912b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925174.363257:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788925174.363277:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00031400/0xb29fc47e1a2912b2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.363287:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d00031400/0xb29fc47e1a2912b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912b9 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925174.363296:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788925174.363301:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788925174.363307:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788925174.363309:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788925174.363331:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.363339:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.363347:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925174.363363:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984064:0@lo:101: 00000100:00100000:0.0:1788925174.363417:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925174.366520:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910984064 00000100:00100000:3.0:1788925174.366533:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910984064 00000100:00100000:3.0:1788925174.366587:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788925174.366596:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+10:6673:x1875823910984064:12345-0@lo:101: 00010000:00010000:3.0:1788925174.366611:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925174.366629:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2912c0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.366654:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2912c0 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925174.366793:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350039c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788925174.367200:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2912c0 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.367210:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8de00, rc 0) 00000100:00100000:3.0:1788925174.367275:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984064:12345-0@lo:101: Request processed in 679us (3856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.367281:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788925174.367516:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984064:0@lo:101: 00010000:00010000:0.0:1788925174.367533:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.367542:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925174.367650:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984192:0@lo:501: 00000100:00100000:0.0:1788925174.368112:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.368144:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.368201:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910984192 00000100:00100000:3.0:1788925174.368207:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910984192 00000100:00100000:3.0:1788925174.368231:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788925174.368237:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984192:12345-0@lo:501: 00000100:00100000:3.0:1788925174.368486:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984192:12345-0@lo:501: Request processed in 247us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.368493:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788925174.368671:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984192:0@lo:501: 00000100:00100000:0.0:1788925174.368704:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984320:0@lo:503: 00000100:00100000:0.0:1788925174.368777:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.368790:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.368939:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910984320 00000100:00100000:3.0:1788925174.368943:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910984320 00000100:00100000:3.0:1788925174.368963:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788925174.368969:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984320:12345-0@lo:503: 00000100:00100000:3.0:1788925174.369203:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984320:12345-0@lo:503: Request processed in 233us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.369210:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788925174.369304:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984320:0@lo:503: 00000040:00080000:0.0:1788925174.369608:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788925174.369676:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984448:0@lo:502: 00000100:00100000:0.0:1788925174.369715:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.369777:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925174.369798:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910984448 00000100:00100000:2.0:1788925174.369804:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910984448 00000100:00100000:2.0:1788925174.369836:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788925174.369847:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984448:12345-0@lo:502: 00000100:00100000:2.0:1788925174.370013:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984448:12345-0@lo:502: Request processed in 169us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.370020:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788925174.370198:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984448:0@lo:502: 00000040:00080000:0.0:1788925174.370410:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788925174.370883:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788925174.370923:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788925174.370972:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788925174.371037:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788925174.371873:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788925174.371918:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984576:0@lo:502: 00000100:00100000:0.0:1788925174.371984:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.372037:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350039c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925174.372052:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910984576 00000100:00100000:1.0:1788925174.372060:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910984576 00000100:00100000:1.0:1788925174.372106:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788925174.372116:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984576:12345-0@lo:502: 00000100:00100000:1.0:1788925174.372288:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984576:12345-0@lo:502: Request processed in 173us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925174.372296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788925174.372324:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984576:0@lo:502: 00000040:00080000:0.0:1788925174.372421:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788925174.372565:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788925174.373274:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788925174.373282:0:6693:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788925174.373289:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925174.373291:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788925174.373296:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788925174.373317:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e0d3f590000) 00000020:00000080:0.0:1788925174.373336:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788925174.373342:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788925174.373434:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0d04b8b800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788925174.373442:0:6693:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788925174.373448:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb29fc47e1a2912d5 00010000:00010000:0.0:1788925174.379443:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788925174.379737:0:6693:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788925174.381616:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788925174.387295:0:6693:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788925174.403899:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788925174.411611:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788925174.416855:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788925174.416868:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925174.416875:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925174.416877:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788925174.416880:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925174.416884:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925174.416885:0:6693:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788925174.416888:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788925174.416896:0:6693:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788925174.416953:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925174.416956:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925174.416957:0:6693:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788925174.416961:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788925174.417594:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788925174.417621:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788925174.417645:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.417666:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925174.417674:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d04b8b800 from 1 10000000:01000000:2.0:1788925174.417677:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788925174.417718:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.417726:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.417737:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925174.417786:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984704:0@lo:101: 00000100:00100000:2.0:1788925174.417849:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925174.417892:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e0826c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.418019:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910984704 00000100:00100000:3.0:1788925174.418028:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910984704 00000100:00100000:3.0:1788925174.418074:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788925174.418083:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+11:6673:x1875823910984704:12345-0@lo:101: 00010000:00010000:3.0:1788925174.418096:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925174.418113:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2912dc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.418135:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2912dc expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.418146:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2912dc expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.418154:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8d200, rc 0) 00000100:00100000:3.0:1788925174.418203:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910984704:12345-0@lo:101: Request processed in 120us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.418209:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788925174.418459:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984704:0@lo:101: 00010000:00010000:0.0:1788925174.418476:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.418486:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925174.418599:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984832:0@lo:501: 00000100:00100000:0.0:1788925174.418632:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.418661:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.418791:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910984832 00000100:00100000:3.0:1788925174.418796:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910984832 00000100:00100000:3.0:1788925174.418821:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788925174.418828:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910984832:12345-0@lo:501: 00000100:00100000:3.0:1788925174.419045:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910984832:12345-0@lo:501: Request processed in 216us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.419052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788925174.419446:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984832:0@lo:501: 00000100:00100000:0.0:1788925174.419479:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984960:0@lo:503: 00000100:00100000:0.0:1788925174.419518:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.419559:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.419700:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910984960 00000100:00100000:3.0:1788925174.419706:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910984960 00000100:00100000:3.0:1788925174.419763:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788925174.419770:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910984960:12345-0@lo:503: 00000100:00100000:3.0:1788925174.419917:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910984960:12345-0@lo:503: Request processed in 147us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.419924:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925174.419984:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910984960:0@lo:503: 00000040:00080000:0.0:1788925174.420392:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788925174.420461:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985088:0@lo:502: 00000100:00100000:0.0:1788925174.420505:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.420541:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.420550:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910985088 00000100:00100000:3.0:1788925174.420566:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910985088 00000100:00100000:3.0:1788925174.420606:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788925174.420614:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910985088:12345-0@lo:502: 00000100:00100000:3.0:1788925174.420763:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910985088:12345-0@lo:502: Request processed in 131us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.420769:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788925174.420965:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985088:0@lo:502: 00000040:00080000:2.0:1788925174.421312:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788925174.421364:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788925174.421408:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985216:0@lo:502: 00000100:00100000:2.0:1788925174.421448:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925174.421482:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e082780 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.421678:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910985216 00000100:00100000:3.0:1788925174.421683:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910985216 00000100:00100000:3.0:1788925174.421717:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788925174.421725:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910985216:12345-0@lo:502: 00000100:00100000:3.0:1788925174.421894:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910985216:12345-0@lo:502: Request processed in 170us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.421901:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788925174.421934:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985216:0@lo:502: 00000040:00080000:0.0:1788925174.422041:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788925174.422058:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788925174.428616:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925174.428629:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925174.428632:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788925174.428639:0:6697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0d04b8b800 00000020:00000080:1.0:1788925174.428641:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788925174.428808:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925174.428813:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925174.428815:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788925174.428819:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788925174.429066:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788925174.429091:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788925174.429117:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.429185:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925174.429224:0:6673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788925174.429227:0:6673:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0d04b8b800 10000000:01000000:3.0:1788925174.429229:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0d04b8b800 10000000:01000000:3.0:1788925174.429233:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788925174.429237:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e0d04b8b800 from 1 10000000:01000000:3.0:1788925174.429240:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788925174.429272:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.429293:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.429304:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925174.429388:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985344:0@lo:101: 00000100:00100000:3.0:1788925174.429452:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925174.429485:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a04c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925174.429589:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910985344 00000100:00100000:2.0:1788925174.429596:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910985344 00000100:00100000:2.0:1788925174.429644:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788925174.429653:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910985344:12345-0@lo:101: 00010000:00010000:2.0:1788925174.429666:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925174.429678:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2912ea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.429701:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2912ea expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.429711:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2912ea expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.429729:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d42045e00, rc 0) 00000100:00100000:2.0:1788925174.429797:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910985344:12345-0@lo:101: Request processed in 144us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.429804:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788925174.429988:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985344:0@lo:101: 00010000:00010000:3.0:1788925174.430011:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.430021:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925174.430105:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985472:0@lo:501: 00000100:00100000:3.0:1788925174.430386:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925174.430477:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a04c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925174.441848:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910985472 00000100:00100000:2.0:1788925174.441862:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910985472 00000100:00100000:2.0:1788925174.441928:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788925174.441939:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910985472:12345-0@lo:501: 00000100:00100000:2.0:1788925174.446945:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910985472:12345-0@lo:501: Request processed in 4999us (16551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.446960:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788925174.447370:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985472:0@lo:501: 00000100:00100000:0.0:1788925174.447443:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985600:0@lo:503: 00000100:00100000:0.0:1788925174.447510:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.447551:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350039c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925174.447672:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910985600 00000100:00100000:1.0:1788925174.447681:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910985600 00000100:00100000:1.0:1788925174.447730:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788925174.447740:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910985600:12345-0@lo:503: 00000100:00100000:1.0:1788925174.447944:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910985600:12345-0@lo:503: Request processed in 205us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925174.447957:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788925174.448053:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985600:0@lo:503: 00000040:00080000:0.0:1788925174.448838:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788925174.448906:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985728:0@lo:502: 00000100:00100000:0.0:1788925174.448953:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.448987:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d350039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925174.449037:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910985728 00000100:00100000:2.0:1788925174.449043:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910985728 00000100:00100000:2.0:1788925174.449080:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788925174.449087:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910985728:12345-0@lo:502: 00000100:00100000:2.0:1788925174.449270:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910985728:12345-0@lo:502: Request processed in 182us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.449277:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788925174.449398:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985728:0@lo:502: 00000040:00080000:1.0:1788925174.449691:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788925174.449777:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788925174.449818:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788925174.449864:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788925174.449902:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788925174.449950:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788925174.449986:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788925174.450032:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788925174.450077:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788925174.450110:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788925174.450141:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788925174.450186:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788925174.450222:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788925174.450256:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788925174.450306:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788925174.450360:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788925174.450395:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788925174.450441:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788925174.450476:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788925174.450508:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788925174.450571:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788925174.450608:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788925174.450640:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788925174.450685:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788925174.450717:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788925174.450791:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788925174.450840:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788925174.450876:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788925174.450912:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985856:0@lo:502: 00000100:00100000:1.0:1788925174.450971:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925174.451034:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f8459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925174.451034:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910985856 00000100:00100000:0.0:1788925174.451043:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910985856 00000100:00100000:0.0:1788925174.451097:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788925174.451106:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910985856:12345-0@lo:502: 00000100:00100000:0.0:1788925174.451318:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910985856:12345-0@lo:502: Request processed in 211us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925174.451325:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788925174.451713:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910985856:0@lo:502: 00000040:00080000:1.0:1788925174.451818:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788925174.451829:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788925174.452808:0:6698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788925174.452823:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e0d3b14cd28) 00000020:00000080:1.0:1788925174.452841:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788925174.452920:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0d04b8b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788925174.452924:0:6698:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0d04b8b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788925174.452926:0:6698:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0d04b8b800 3 00010000:00080000:1.0:1788925174.452953:0:6698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0d3f85f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.104@tcp at head 00010000:00010000:1.0:1788925174.456440:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788925174.456828:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788925174.456865:0:6698:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788925174.456879:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb29fc47e1a2912ff 00000100:00080000:1.0:1788925174.456889:0:6698:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925174.456895:0:6698:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e0d3f85f800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:1.0:1788925174.456926:0:6698:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0d06a9ed80 x1875823910985984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788925174.456985:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875823910985984:0@lo:38: 00000100:00100000:3.0:1788925174.457067:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788925174.457141:0:6698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788925174.457791:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823910986112:0@lo:400: 00000100:00100000:1.0:1788925174.457836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925174.457930:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910985984 00000100:00100000:3.0:1788925174.457939:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910985984 00000100:00100000:2.0:1788925174.457950:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910986112 00000100:00100000:2.0:1788925174.457957:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910986112 00000100:00100000:3.0:1788925174.457977:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925174.457986:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875823910985984:12345-0@lo:38: 00000100:00100000:2.0:1788925174.457991:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788925174.458011:0:5840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:3.0:1788925174.458024:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:3.0:1788925174.458065:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb29fc47e1a291306 00000004:00100000:3.0:1788925174.458081:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788925174.458112:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9e0d3f53f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925174.458142:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788925174.458152:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823910986112:12345-0@lo:400: 00000100:00100000:3.0:1788925174.458187:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875823910985984:12345-0@lo:38: Request processed in 199us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.458194:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788925174.458238:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e0d06a9ed80 x1875823910985984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925174.458247:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788925174.458254:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788925174.458261:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788925174.458265:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788925174.458268:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e0d3f85f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788925174.458274:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875823910985984:0@lo:38: 00000040:00080000:1.0:1788925174.465153:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788925174.465370:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788925174.465408:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788925174.465432:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.465444:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788925174.465495:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788925174.465497:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788925174.465504:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925174.465506:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925174.465507:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925174.465509:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925174.465511:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788925174.465512:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788925174.465514:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788925174.465515:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925174.465517:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788925174.465521:0:6673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788925174.465524:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788925174.465525:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788925174.465526:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925174.465527:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925174.465528:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925174.465529:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925174.465530:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788925174.465531:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788925174.465533:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788925174.465534:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925174.465535:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788925174.465560:0:6673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788925174.465577:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910986240:0@lo:253: 00000100:00100000:0.0:1788925174.465639:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925174.465681:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d35003900 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.465737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910986240 00000100:00100000:3.0:1788925174.466070:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910986240 00000100:00100000:3.0:1788925174.466120:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788925174.466216:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:6673:x1875823910986240:12345-0@lo:253: 20000000:01000000:3.0:1788925174.466255:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788925174.466267:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788925174.468189:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e0d34e96680 x1875823910986112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925174.468207:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823910986112:0@lo:400: 00000100:00100000:2.0:1788925174.468368:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823910986112:12345-0@lo:400: Request processed in 10216us (10529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.468459:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:3.0:1788925174.535221:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788925174.535243:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788925174.535474:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788925174.535479:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788925174.535500:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.535518:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a29126c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291265 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.535527:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.535581:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a29126c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a291265 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.535595:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a29126c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a291265 expref: 13 pid: 5831 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925174.535608:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875823910986368:0@lo:104: 00000100:00100000:2.0:1788925174.535668:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925174.535730:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d186d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788925174.535828:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910986368 00000100:00100000:3.0:1788925174.535835:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910986368 00000100:00100000:3.0:1788925174.535885:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788925174.535894:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:5854:x1875823910986368:12345-0@lo:104: 00010000:00010000:3.0:1788925174.535907:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a600/0xb29fc47e1a291265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.535970:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925174.535976:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:5854:x1875823910986368:12345-0@lo:104: Request processed in 84us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.535983:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788925174.536028:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875823910986368:0@lo:104: 00010000:00010000:3.0:1788925174.536045:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.536261:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925174.536269:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a600/0xb29fc47e1a291265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.536278:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148a600 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925174.536283:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a600/0xb29fc47e1a291265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.536304:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a600/0xb29fc47e1a291265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925174.536312:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a600/0xb29fc47e1a291265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925174.536317:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925174.536352:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a600/0xb29fc47e1a291265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.536359:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925174.536376:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a600/0xb29fc47e1a291265 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.536383:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a600/0xb29fc47e1a291265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29126c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.536510:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925174.536512:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925174.536514:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925174.536527:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910986496:0@lo:103: 00000100:00100000:0.0:1788925174.536655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925174.540682:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910986496 00000100:00100000:3.0:1788925174.540696:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910986496 00010000:00010000:3.0:1788925174.540738:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a29126c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291265 expref: 14 pid: 5831 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925174.540793:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788925174.540802:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d085ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+14:3305:x1875823910986496:12345-0@lo:103: 00010000:00010000:3.0:1788925174.540816:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925174.540822:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a29126c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291265 expref: 14 pid: 5831 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.540834:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a29126c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a291265 expref: 14 pid: 5831 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.540851:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a29126c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a291265 expref: 14 pid: 5831 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.540868:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.540893:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788925174.540910:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005431569s 00010000:00010000:3.0:1788925174.540915:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.540922:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.540928:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.540936:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.540942:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045c00 already unused, calling callback (ffffffffc141f230) 00010000:00010000:3.0:1788925174.540946:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.540954:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.541164:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925174.541173:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.541222:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.541231:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29130d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.541245:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925174.541430:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d085ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+13:3305:x1875823910986496:12345-0@lo:103: Request processed in 628us (4773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925174.541443:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788925174.541822:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910986496:0@lo:103: 00000100:00100000:2.0:1788925174.557025:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:6673:x1875823910986240:12345-0@lo:253: Request processed in 90888us (91376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925174.557039:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788925174.557284:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:6673:1875823910986240:0@lo:253: 10000000:01000000:1.0:1788925174.557301:0:6673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788925174.557304:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788925174.557306:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788925174.557308:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925174.557309:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925174.557310:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925174.557312:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925174.557313:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788925174.557315:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788925174.557316:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788925174.557318:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925174.557320:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788925174.557334:0:6673:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788925174.561525:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925174.563490:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788925174.564191:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925174.564356:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788925174.565469:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788925174.566050:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788925174.567381:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788925174.764260:0:6673:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788925174.764269:0:6673:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788925174.764382:0:6673:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788925174.764439:0:6673:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788925174.764455:0:6673:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788925174.764482:0:6673:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788925174.849874:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925175.874422:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925176.901046:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925177.922032:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925178.946032:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925179.972580:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823910986752:0@lo:400: 00000100:00100000:2.0:1788925179.972647:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925179.972703:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925179.972709:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910986624:0@lo:400: 00000100:00100000:2.0:1788925179.972766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925179.972796:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875823910986880:0@lo:400: 00000100:00100000:2.0:1788925179.972821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925179.972848:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925179.972861:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910986752 00000100:00100000:2.0:1788925179.972867:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910986752 00000100:00100000:2.0:1788925179.972901:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910986880 00000100:00100000:2.0:1788925179.972904:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910986880 00000100:00100000:2.0:1788925179.972938:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788925179.972946:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823910986752:12345-0@lo:400: 00000100:00100000:2.0:1788925179.973004:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823910986752:12345-0@lo:400: Request processed in 58us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925179.973011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788925179.973027:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925179.973034:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875823910986880:12345-0@lo:400: 00000100:00100000:2.0:1788925179.973077:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875823910986880:12345-0@lo:400: Request processed in 43us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925179.973083:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925179.973101:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910986624 00000100:00100000:2.0:1788925179.973105:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910986624 00000100:00100000:2.0:1788925179.973129:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788925179.973135:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:3307:x1875823910986624:12345-0@lo:400: 00000100:00100000:2.0:1788925179.973163:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:3307:x1875823910986624:12345-0@lo:400: Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925179.973169:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788925179.973217:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d3b0ff100 x1875823910986880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925179.973242:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875823910986880:0@lo:400: 00000100:00100000:2.0:1788925179.973270:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910986624:0@lo:400: 00010000:00080000:2.0:1788925179.973280:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d3b0fea00 x1875823910986752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925179.973289:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823910986752:0@lo:400: 00000100:00080000:3.0:1788925179.973414:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925180.995382:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925181.134668:0:7044:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788925181.504805:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788925181.504871:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e0d1882f800 from 21 10000000:01000000:3.0:1788925181.504876:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788925181.504918:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925181.504928:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925181.504940:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925181.504972:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987008:0@lo:101: 00000100:00100000:3.0:1788925181.505036:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.505095:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910987008 00000100:00100000:2.0:1788925181.505104:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910987008 00000100:00100000:2.0:1788925181.505151:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788925181.505156:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d0b770000 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.505160:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823910987008:12345-0@lo:101: 00010000:00010000:2.0:1788925181.505173:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925181.505186:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291314 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.505208:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291314 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.505218:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291314 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.505226:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d42045c00, rc 0) 00000100:00100000:2.0:1788925181.505275:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823910987008:12345-0@lo:101: Request processed in 115us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.505281:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788925181.505618:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987008:0@lo:101: 00010000:00010000:3.0:1788925181.505634:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925181.505643:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925181.505691:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987136:0@lo:501: 00000100:00100000:3.0:1788925181.505718:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925181.506934:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d0b770000 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.507696:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910987136 00000100:00100000:2.0:1788925181.507705:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910987136 00000100:00100000:2.0:1788925181.507774:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788925181.507792:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823910987136:12345-0@lo:501: 00000100:00100000:2.0:1788925181.508083:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823910987136:12345-0@lo:501: Request processed in 292us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.508091:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788925181.508209:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987136:0@lo:501: 00000100:00100000:1.0:1788925181.508255:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987264:0@lo:503: 00000100:00100000:1.0:1788925181.508301:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925181.508344:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0c027fa480 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.510106:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910987264 00000100:00100000:2.0:1788925181.510118:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910987264 00000100:00100000:2.0:1788925181.510187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788925181.510200:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823910987264:12345-0@lo:503: 00000100:00100000:2.0:1788925181.510435:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823910987264:12345-0@lo:503: Request processed in 238us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.510443:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788925181.516200:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987264:0@lo:503: 00000100:00100000:2.0:1788925181.523388:0:7062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7062:1875823910987392:0@lo:502: 00000100:00100000:2.0:1788925181.523464:0:7062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.523510:0:7062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925181.523561:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910987392 00000100:00100000:0.0:1788925181.523568:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910987392 00000100:00100000:0.0:1788925181.523617:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788925181.523627:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:7062:x1875823910987392:12345-0@lo:502: 00000100:00100000:0.0:1788925181.523885:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:7062:x1875823910987392:12345-0@lo:502: Request processed in 259us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925181.523894:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788925181.524014:0:7062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7062:1875823910987392:0@lo:502: 00000100:00100000:2.0:1788925181.524062:0:7062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7062:1875823910987520:0@lo:502: 00000100:00100000:2.0:1788925181.524095:0:7062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.524125:0:7062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925181.528148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910987520 00000100:00100000:0.0:1788925181.528163:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910987520 00000100:00100000:0.0:1788925181.528235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788925181.528246:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:7062:x1875823910987520:12345-0@lo:502: 00000100:00100000:0.0:1788925181.528520:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:7062:x1875823910987520:12345-0@lo:502: Request processed in 275us (4423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925181.528528:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788925181.528631:0:7062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7062:1875823910987520:0@lo:502: 00000040:00080000:2.0:1788925181.528666:0:7062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788925181.529006:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788925181.529030:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788925181.529039:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925181.529049:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925181.529058:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788925181.529060:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e0d1882f800 from 4 10000000:01000000:0.0:1788925181.529063:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788925181.529093:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925181.529112:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925181.529122:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925181.529140:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987648:0@lo:101: 00000100:00100000:0.0:1788925181.529174:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925181.529210:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a06900 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.529252:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910987648 00000100:00100000:2.0:1788925181.529257:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910987648 00000100:00100000:2.0:1788925181.529290:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788925181.529298:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823910987648:12345-0@lo:101: 00010000:00010000:2.0:1788925181.529307:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925181.529326:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291322 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529347:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291322 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529357:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291322 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529366:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d42045800, rc 0) 00000100:00100000:2.0:1788925181.529403:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910987648:12345-0@lo:101: Request processed in 105us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.529409:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788925181.529439:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987648:0@lo:101: 00010000:00010000:2.0:1788925181.529452:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529460:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925181.529502:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987776:0@lo:256: 00000100:00100000:2.0:1788925181.529530:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.529542:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.529553:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910987776 00000100:00100000:2.0:1788925181.529556:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910987776 00000100:00100000:2.0:1788925181.529572:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788925181.529577:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910987776:12345-0@lo:256: 20000000:01000000:2.0:1788925181.529589:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788925181.529603:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788925181.529609:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788925181.529679:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910987776:12345-0@lo:256: Request processed in 101us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.529686:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788925181.529712:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987776:0@lo:256: 10000000:01000000:2.0:1788925181.529775:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788925181.529781:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529789:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925181.529796:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788925181.529798:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788925181.529800:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788925181.529815:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529822:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529829:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925181.529840:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987904:0@lo:101: 00000100:00100000:2.0:1788925181.529864:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.529882:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.529893:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910987904 00000100:00100000:2.0:1788925181.529896:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910987904 00000100:00100000:2.0:1788925181.529912:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788925181.529923:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910987904:12345-0@lo:101: 00010000:00010000:2.0:1788925181.529930:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925181.529938:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291330 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529962:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291330 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529972:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291330 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.529979:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d42044e00, rc 0) 00000100:00100000:2.0:1788925181.530005:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910987904:12345-0@lo:101: Request processed in 82us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.530012:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788925181.530036:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910987904:0@lo:101: 00010000:00010000:2.0:1788925181.530046:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.530054:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925181.530091:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910988032:0@lo:501: 00000100:00100000:2.0:1788925181.530115:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.530126:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.530136:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910988032 00000100:00100000:2.0:1788925181.530140:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910988032 00000100:00100000:2.0:1788925181.530156:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788925181.530161:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910988032:12345-0@lo:501: 00000100:00100000:2.0:1788925181.530377:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910988032:12345-0@lo:501: Request processed in 214us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.530383:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788925181.530411:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910988032:0@lo:501: 00000100:00100000:2.0:1788925181.530434:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910988160:0@lo:503: 00000100:00100000:2.0:1788925181.530468:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.530481:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.530492:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910988160 00000100:00100000:2.0:1788925181.530496:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910988160 00000100:00100000:2.0:1788925181.530511:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788925181.530516:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910988160:12345-0@lo:503: 00000100:00100000:2.0:1788925181.530697:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910988160:12345-0@lo:503: Request processed in 180us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.530705:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788925181.530738:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910988160:0@lo:503: 00000100:00100000:2.0:1788925181.530918:0:7063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7063:1875823910988288:0@lo:502: 00000100:00100000:2.0:1788925181.530950:0:7063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.530979:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910988288 00000100:00100000:2.0:1788925181.530983:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910988288 00000100:00100000:2.0:1788925181.531000:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788925181.531005:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:7063:x1875823910988288:12345-0@lo:502: 00000100:00100000:2.0:1788925181.531188:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:7063:x1875823910988288:12345-0@lo:502: Request processed in 182us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.531195:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788925181.531229:0:7063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d033986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.531247:0:7063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7063:1875823910988288:0@lo:502: 00000020:01000000:2.0:1788925181.531267:0:7063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788925181.531273:0:7063:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788925181.531279:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925181.531281:0:7063:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788925181.531286:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788925181.531290:0:7063:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:2.0:1788925181.531309:0:7063:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788925181.531311:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925181.531326:0:7063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e0d10580000) 00000020:00000080:2.0:1788925181.531341:0:7063:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788925181.531346:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788925181.531403:0:7063:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788925181.531408:0:7063:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788925181.531423:0:7063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb29fc47e1a291345 00010000:00080000:2.0:1788925181.531452:0:7063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0d11f32000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:2.0:1788925181.531663:0:7063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788925181.613571:0:7063:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788925181.613591:0:7063:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788925181.614413:0:7063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788925181.614580:0:7063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788925181.614628:0:7063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788925181.614685:0:7063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788925181.615379:0:7069:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788925181.615384:0:7069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788925181.616474:0:7063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788925181.616488:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788925181.616520:0:7063:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788925181.616542:0:7063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb29fc47e1a29134c 00000100:00080000:3.0:1788925181.616552:0:7063:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788925181.616558:0:7063:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e0d11f32000 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788925181.616591:0:7063:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0d34e94700 x1875823910988416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788925181.616651:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875823910988416:0@lo:8: 00000100:00100000:2.0:1788925181.616733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788925181.616893:0:7063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788925181.616960:0:7063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925181.616964:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925181.616966:0:7063:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788925181.616970:0:7063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925181.616974:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925181.616975:0:7063:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788925181.616979:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788925181.616980:0:7063:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788925181.617002:0:7063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e95c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7063:1875823910988544:0@lo:502: 00000100:00100000:3.0:1788925181.617045:0:7063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925181.617063:0:7063:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d0b770e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925181.621236:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823910988800:0@lo:400: 00000100:00100000:3.0:1788925181.621300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925181.621436:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910988416 00000100:00100000:0.0:1788925181.621444:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910988416 00000100:00100000:0.0:1788925181.621486:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925181.621494:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875823910988416:12345-0@lo:8: 00010000:00080000:0.0:1788925181.621521:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788925181.621547:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb29fc47e1a291353 00002000:00100000:0.0:1788925181.621585:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e0d3f59e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788925181.621590:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788925181.621594:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788925181.621714:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788925181.621873:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788925181.621898:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9e0d3f59d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925181.622056:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823910988672:0@lo:400: 00000100:00100000:2.0:1788925181.622091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.622145:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910988544 00000100:00100000:2.0:1788925181.622149:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910988544 00000100:00100000:2.0:1788925181.622187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788925181.622204:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d101a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:7063:x1875823910988544:12345-0@lo:502: 00000100:00100000:2.0:1788925181.622417:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d101a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:7063:x1875823910988544:12345-0@lo:502: Request processed in 213us (5370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.622424:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788925181.622474:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910988800 00000100:00100000:2.0:1788925181.622478:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910988800 00000100:00100000:2.0:1788925181.622509:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910988672 00000100:00100000:2.0:1788925181.622511:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910988672 00000100:00100000:2.0:1788925181.622527:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925181.622533:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823910988800:12345-0@lo:400: 00000100:00100000:2.0:1788925181.622570:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823910988800:12345-0@lo:400: Request processed in 37us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.622576:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925181.622588:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788925181.622594:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823910988672:12345-0@lo:400: 00000100:00100000:2.0:1788925181.622622:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823910988672:12345-0@lo:400: Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.622628:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788925181.622645:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788925181.622675:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d34e96a00 x1875823910988672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925181.622688:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823910988672:0@lo:400: 00010000:00080000:2.0:1788925181.622717:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d34e97100 x1875823910988800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925181.622726:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823910988800:0@lo:400: 00000100:00100000:2.0:1788925181.622769:0:7063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e95c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7063:1875823910988544:0@lo:502: 00000020:01000000:2.0:1788925181.622804:0:7063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925181.622810:0:7063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925181.622812:0:7063:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788925181.622817:0:7063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788925181.624288:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788925181.624314:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788925181.624324:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.624334:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925181.624345:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788925181.624347:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e0d06a20000 from 1 10000000:01000000:2.0:1788925181.624350:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788925181.624382:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.624390:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.624399:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925181.624419:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910988928:0@lo:101: 00000100:00100000:2.0:1788925181.624468:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.624519:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398240 going to sleep for 11 seconds 00000100:00100000:3.0:1788925181.628056:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910988928 00000100:00100000:3.0:1788925181.628071:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910988928 00000100:00100000:3.0:1788925181.628137:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788925181.628161:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910988928:12345-0@lo:101: 00010000:00010000:3.0:1788925181.628181:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925181.628199:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29135a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925181.628228:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29135a expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925181.628240:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29135a expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925181.628249:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8cc00, rc 0) 00000100:00100000:3.0:1788925181.628319:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823910988928:12345-0@lo:101: Request processed in 161us (3850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925181.628326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788925181.628465:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875823910988416:12345-0@lo:8: Request processed in 6968us (11730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925181.628473:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788925181.628643:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d34e94700 x1875823910988416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788925191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925181.628653:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788925181.628670:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788925181.628678:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788925181.628683:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788925181.628686:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e0d11f32000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788925181.628706:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788925181.628712:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875823910988416:0@lo:8: 00000100:00100000:2.0:1788925181.628852:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910988928:0@lo:101: 00010000:00010000:2.0:1788925181.628868:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.628878:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925181.628937:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910989056:0@lo:501: 00000100:00100000:2.0:1788925181.628980:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.629007:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398240 going to sleep for 11 seconds 00000100:00100000:2.0:1788925181.629025:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910989056 00000100:00100000:2.0:1788925181.629029:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910989056 00000100:00100000:2.0:1788925181.629052:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788925181.629058:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823910989056:12345-0@lo:501: 00000100:00100000:2.0:1788925181.629266:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823910989056:12345-0@lo:501: Request processed in 207us (284us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788925181.629273:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788925181.629301:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910989056:0@lo:501: 10000000:01000000:2.0:1788925181.629322:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788925181.629328:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925181.629341:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788925181.629573:0:7069:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788925181.629660:0:7069:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190556916336ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788925181.664004:0:7070:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788925181.664036:0:7070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e94000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7070:1875823910989312:0@lo:7: 00000100:00100000:3.0:1788925181.664117:0:7070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925181.664163:0:7070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d0b770480 going to sleep for 11 seconds 00000100:00100000:3.0:1788925181.664181:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823910989184:0@lo:13: 00000100:00100000:3.0:1788925181.664204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925181.664249:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910989312 00000100:00100000:3.0:1788925181.664256:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910989312 00000100:00100000:3.0:1788925181.664303:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925181.664312:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7070:x1875823910989312:12345-0@lo:7: 00000004:00080000:1.0:1788925181.667619:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788925181.670486:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788925181.670494:0:6678:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00080000:2.0:1788925181.670640:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925181.670667:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910989184 00000100:00100000:2.0:1788925181.670675:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910989184 00000100:00100000:2.0:1788925181.670728:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788925181.670738:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875823910989184:12345-0@lo:13: 00002000:00000024:2.0:1788925181.670781:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788925181.670857:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875823910989184:12345-0@lo:13: Request processed in 121us (6651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925181.670863:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788925181.671010:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d34e95880 x1875823910989184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925181.671037:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823910989184:0@lo:13: 00000100:00100000:3.0:1788925181.671090:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7070:x1875823910989312:12345-0@lo:7: Request processed in 6779us (6974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925181.671097:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788925181.671173:0:7070:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d34e94000 x1875823910989312/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788925197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925181.671184:0:7070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e94000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7070:1875823910989312:0@lo:7: 00000004:00080000:2.0:1788925181.671193:0:7070:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788925181.671223:0:7070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7070:1875823910989440:0@lo:5: 00000100:00100000:2.0:1788925181.671256:0:7070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.671294:0:7070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398600 going to sleep for 11 seconds 00000100:00100000:3.0:1788925181.671343:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910989440 00000100:00100000:3.0:1788925181.671348:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910989440 00000100:00100000:3.0:1788925181.671412:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925181.671419:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7070:x1875823910989440:12345-0@lo:5: 00002000:00080000:3.0:1788925181.671437:0:6676:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788925181.671441:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788925181.671667:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7070:x1875823910989440:12345-0@lo:5: Request processed in 247us (409us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788925181.671674:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788925181.673360:0:7070:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d3b0ff100 x1875823910989440/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925181.673379:0:7070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7070:1875823910989440:0@lo:5: 00000004:00080000:2.0:1788925181.673392:0:7070:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788925181.673426:0:7070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7070:1875823910989568:0@lo:700: 00000100:00100000:2.0:1788925181.673489:0:7070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.673532:0:7070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d03398600 going to sleep for 11 seconds 00000100:00100000:0.0:1788925181.673645:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910989568 00000100:00100000:0.0:1788925181.673652:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910989568 00000100:00100000:0.0:1788925181.673697:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925181.673707:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7070:x1875823910989568:12345-0@lo:700: 00000100:00100000:0.0:1788925181.673756:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1875823910989696:0@lo:700: 00000100:00100000:0.0:1788925181.673791:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925181.673808:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a06cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925181.673827:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910989696 00000100:00100000:0.0:1788925181.673831:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910989696 00000100:00100000:0.0:1788925181.673857:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925181.673864:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1875823910989696:12345-0@lo:700: 40000000:02000000:1.0:1788925181.719789:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788925181.734858:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1875823910989696:12345-0@lo:700: Request processed in 60986us (61058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925181.734877:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788925181.735801:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d2e7e0700 x1875823910989696/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788925197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925181.735829:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1875823910989696:0@lo:700: 40000000:02000000:3.0:1788925181.735841:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1788925181.823114:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788925181.823138:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1788925181.823281:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7070:x1875823910989568:12345-0@lo:700: Request processed in 149570us (149786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925181.823293:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788925181.823380:0:7070:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d3b0fed80 x1875823910989568/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788925197 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925181.823391:0:7070:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788925181.823406:0:7070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7070:1875823910989568:0@lo:700: 00000004:02000040:3.0:1788925181.865560:0:7070:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788925181.869911:0:7070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7070:1875823910989824:0@lo:5: 00000100:00100000:2.0:1788925181.869993:0:7070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925181.870041:0:7070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d02ce7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788925181.870614:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910989824 00000100:00100000:3.0:1788925181.870630:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910989824 00000100:00100000:3.0:1788925181.870725:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925181.870735:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7070:x1875823910989824:12345-0@lo:5: 00002000:00080000:0.0:1788925181.882443:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788925181.882462:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788925181.890531:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7070:x1875823910989824:12345-0@lo:5: Request processed in 19790us (20531us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788925181.890543:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788925181.890688:0:7070:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d3b0fe300 x1875823910989824/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925197 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925181.890706:0:7070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7070:1875823910989824:0@lo:5: 00000004:00080000:3.0:1788925181.890726:0:7070:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788925182.016837:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925183.044102:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925184.064963:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925185.091000:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788925185.912862:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788925186.114316:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925186.625496:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823910990080:0@lo:400: 00000100:00100000:1.0:1788925186.625561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925186.625621:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925186.625627:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910989952:0@lo:400: 00000100:00100000:1.0:1788925186.625657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925186.625697:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910990080 00000100:00100000:1.0:1788925186.625704:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910990080 00000100:00100000:1.0:1788925186.625764:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788925186.625774:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823910990080:12345-0@lo:400: 00000100:00100000:0.0:1788925186.625793:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910989952 00000100:00100000:0.0:1788925186.625797:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910989952 00000100:00100000:0.0:1788925186.625823:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788925186.625829:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+16:3305:x1875823910989952:12345-0@lo:400: 00000100:00100000:0.0:1788925186.625875:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+16:3305:x1875823910989952:12345-0@lo:400: Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925186.625882:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788925186.626173:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823910990208:0@lo:400: 00000100:00100000:3.0:1788925186.626203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925186.626223:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925186.626229:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823910990336:0@lo:400: 00000100:00100000:3.0:1788925186.626254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925186.626289:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910990208 00000100:00100000:3.0:1788925186.626294:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910990208 00000100:00100000:3.0:1788925186.626328:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788925186.626334:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823910990208:12345-0@lo:400: 00000100:00100000:3.0:1788925186.626370:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823910990208:12345-0@lo:400: Request processed in 36us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925186.626377:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788925186.626384:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910990336 00000100:00080000:3.0:1788925186.626392:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925186.626396:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910990336 00000100:00100000:0.0:1788925186.626428:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788925186.626434:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823910990336:12345-0@lo:400: 00000100:00100000:0.0:1788925186.626465:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823910990336:12345-0@lo:400: Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925186.626471:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788925186.626555:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788925186.626580:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d06a9ca80 x1875823910990336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925186.626591:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788925186.626604:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823910990336:0@lo:400: 00010000:00080000:3.0:1788925186.626623:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d06a9e300 x1875823910990208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925186.626631:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823910990208:0@lo:400: 00000100:00100000:1.0:1788925186.626700:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823910990080:12345-0@lo:400: Request processed in 926us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925186.626706:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788925186.626740:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910989952:0@lo:400: 00010000:00080000:1.0:1788925186.626778:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d06a9f100 x1875823910990080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925186.626788:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823910990080:0@lo:400: 00000100:00100000:3.0:1788925187.136876:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925187.136900:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823910990464:0@lo:13: 00000100:00100000:3.0:1788925187.136983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925187.137053:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910990464 00000100:00100000:3.0:1788925187.137060:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910990464 00000100:00100000:3.0:1788925187.137237:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925187.137247:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823910990464:12345-0@lo:13: 00002000:00000024:3.0:1788925187.137284:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925187.137330:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823910990464:12345-0@lo:13: Request processed in 84us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925187.137337:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788925187.137379:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d34e94700 x1875823910990464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925187.137396:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823910990464:0@lo:13: 00010000:00010000:2.0:1788925187.137596:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925188.161062:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925189.191276:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925190.209914:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925191.233829:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925191.746012:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910990592:0@lo:400: 00000100:00100000:3.0:1788925191.746082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925191.746174:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910990592 00000100:00100000:1.0:1788925191.746182:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910990592 00000100:00100000:1.0:1788925191.746223:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788925191.746231:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:3305:x1875823910990592:12345-0@lo:400: 00000100:00100000:1.0:1788925191.746932:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:3305:x1875823910990592:12345-0@lo:400: Request processed in 699us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925191.747007:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788925191.747089:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823910990976:0@lo:400: 00000100:00100000:0.0:1788925191.747144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925191.747160:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910990592:0@lo:400: 00000100:00100000:1.0:1788925191.747188:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910990976 00000100:00100000:3.0:1788925191.747190:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823910990720:0@lo:400: 00000100:00100000:1.0:1788925191.747194:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910990976 00000100:00100000:3.0:1788925191.747222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925191.747246:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925191.747252:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823910990848:0@lo:400: 00000100:00100000:1.0:1788925191.747292:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925191.747297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925191.747305:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823910990976:12345-0@lo:400: 00000100:00100000:1.0:1788925191.747349:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823910990976:12345-0@lo:400: Request processed in 48us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925191.747356:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925191.747387:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910990720 00000100:00100000:3.0:1788925191.747392:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910990720 00000100:00100000:3.0:1788925191.747425:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910990848 00000100:00100000:3.0:1788925191.747429:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910990848 00000100:00100000:1.0:1788925191.747461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925191.747470:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823910990720:12345-0@lo:400: 00000100:00100000:1.0:1788925191.747509:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823910990720:12345-0@lo:400: Request processed in 41us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925191.747515:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788925191.747566:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788925191.747572:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925191.747589:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925191.747599:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823910990848:12345-0@lo:400: 00010000:00080000:0.0:1788925191.747602:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d2e7e1880 x1875823910990976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925191.747617:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823910990976:0@lo:400: 00000100:00100000:3.0:1788925191.747638:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823910990848:12345-0@lo:400: Request processed in 41us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925191.747645:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788925191.747676:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d2e7e0380 x1875823910990848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925191.747686:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823910990848:0@lo:400: 00010000:00080000:3.0:1788925191.747695:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d2e7e3100 x1875823910990720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925191.747704:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823910990720:0@lo:400: 00000020:01000004:3.0:1788925192.076840:0:7620:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788925192.076844:0:7620:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788925192.077115:0:7620:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e0d0b757000 00000020:01000004:3.0:1788925192.077132:0:7620:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788925192.077145:0:7620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788925192.077159:0:7620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e0d0841cd28) 00000020:00000080:3.0:1788925192.077178:0:7620:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788925192.096214:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788925192.096495:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788925192.154679:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788925192.166930:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788925192.166963:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788925192.167020:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788925192.167049:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788925192.167374:0:7620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788925192.167385:0:7620:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788925192.167397:0:7620:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb29fc47e1a29136f 00000020:01000004:2.0:1788925192.167405:0:7620:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788925192.167426:0:7620:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788925192.167429:0:7620:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788925192.167435:0:7620:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788925192.167455:0:7620:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788925192.167464:0:7620:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788925192.203463:0:7620:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788925192.203501:0:7620:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.104@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788925192.203505:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788925192.203507:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788925192.203509:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925192.203510:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925192.203512:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925192.203513:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925192.203515:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788925192.203517:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788925192.203518:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788925192.203520:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925192.203521:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788925192.203525:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788925192.203527:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788925192.203529:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788925192.203530:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925192.203531:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925192.203537:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925192.203538:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925192.203539:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788925192.203539:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788925192.203540:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788925192.203541:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925192.203542:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788925192.203568:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788925192.203585:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910991104:0@lo:253: 00000100:00100000:1.0:1788925192.203656:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925192.203720:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925192.203898:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910991104 00000100:00100000:2.0:1788925192.203907:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910991104 00000100:00100000:2.0:1788925192.203959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788925192.203969:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:7620:x1875823910991104:12345-0@lo:253: 20000000:01000000:2.0:1788925192.204007:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788925192.204011:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788925192.204016:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788925192.204019:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788925192.205125:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925192.205343:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788925192.205357:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788925192.205394:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788925192.205401:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788925192.205443:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788925192.205492:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788925192.205863:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788925192.205879:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:3.0:1788925192.205881:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:3.0:1788925192.205925:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788925192.205933:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788925192.205974:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788925192.205981:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:3.0:1788925192.206013:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788925192.206022:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788925192.206054:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788925192.206113:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788925192.206837:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788925192.206854:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.104@tcp 20000000:01000000:3.0:1788925192.206856:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.104@tcp (null) (null) (null) 00000040:00080000:3.0:1788925192.206904:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788925192.206912:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788925192.206958:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788925192.206965:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.104@tcp (null) (null) 00000040:00080000:3.0:1788925192.207011:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788925192.207020:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788925192.207066:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788925192.207103:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788925192.207118:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788925192.207121:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788925192.207127:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788925192.207128:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788925192.207130:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788925192.207143:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788925192.207146:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788925192.207178:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788925192.207186:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788925192.210954:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788925192.211444:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788925192.211492:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788925192.211562:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788925192.211575:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788925192.211578:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788925192.213672:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788925192.213818:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788925192.213878:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788925192.216056:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788925192.216101:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788925192.216177:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788925192.216190:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788925192.216192:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788925192.218846:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788925192.218945:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788925192.218998:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788925192.219374:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788925192.219419:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788925192.219456:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788925192.219468:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788925192.219470:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788925192.221102:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788925192.221222:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788925192.221258:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788925192.221625:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788925192.221673:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788925192.221800:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788925192.221824:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788925192.221846:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.221865:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2912c0 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.221873:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2912ea expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.221879:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291314 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.221897:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291330 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.221904:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29135a expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.221911:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.221966:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a29135a expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.221982:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a29135a expref: 16 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.221996:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0ff800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991232:0@lo:104: 00000100:00100000:2.0:1788925192.222064:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925192.222113:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a291330 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.222122:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a291330 expref: 16 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.222131:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991360:0@lo:104: 00010000:00010000:2.0:1788925192.222156:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a291314 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.222164:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a291314 expref: 16 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.222173:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991488:0@lo:104: 00010000:00010000:2.0:1788925192.222198:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2912ea expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.222206:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2912ea expref: 16 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.222213:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991616:0@lo:104: 00010000:00010000:2.0:1788925192.222260:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2912c0 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.222268:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2912c0 expref: 16 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.222287:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991744:0@lo:104: 00000100:00100000:2.0:1788925192.222309:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0c027fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1788925192.222976:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788925192.222999:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.223027:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.223036:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.223044:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.223054:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910991232 00000100:00100000:3.0:1788925192.223060:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910991232 00000100:00100000:3.0:1788925192.223093:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910991360 00000100:00100000:3.0:1788925192.223096:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910991360 00000100:00100000:3.0:1788925192.223106:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910991488 00000100:00100000:3.0:1788925192.223194:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910991488 00000100:00100000:3.0:1788925192.223211:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910991616 00000100:00100000:3.0:1788925192.223214:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910991616 00000100:00100000:3.0:1788925192.223222:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910991744 00000100:00100000:3.0:1788925192.223224:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910991744 00000100:00100000:3.0:1788925192.223247:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925192.223256:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d11fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+7:5833:x1875823910991232:12345-0@lo:104: 00010000:00010000:3.0:1788925192.223269:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.223485:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925192.223492:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d11fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+7:5833:x1875823910991232:12345-0@lo:104: Request processed in 238us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.223500:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925192.223542:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925192.223550:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+6:5833:x1875823910991360:12345-0@lo:104: 00010000:00010000:3.0:1788925192.223557:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.223599:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788925192.223604:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+6:5833:x1875823910991360:12345-0@lo:104: Request processed in 56us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.223610:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925192.223623:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788925192.223628:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+5:5833:x1875823910991488:12345-0@lo:104: 00010000:00010000:3.0:1788925192.223636:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.223664:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788925192.223668:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+5:5833:x1875823910991488:12345-0@lo:104: Request processed in 41us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.223673:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788925192.223696:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788925192.223711:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+4:5833:x1875823910991616:12345-0@lo:104: 00010000:00010000:1.0:1788925192.223717:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788925192.223719:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223724:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223741:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044600 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:1.0:1788925192.223764:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223773:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.223776:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788925192.223781:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+4:5833:x1875823910991616:12345-0@lo:104: Request processed in 72us (744us total) trans 0 rc 0/0 10000000:00010000:1.0:1788925192.223781:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925192.223787:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788925192.223788:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788925192.223799:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925192.223805:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+3:5833:x1875823910991744:12345-0@lo:104: 00010000:00010000:3.0:1788925192.223811:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223823:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223829:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925192.223834:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788925192.223838:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+3:5833:x1875823910991744:12345-0@lo:104: Request processed in 33us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.223843:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788925192.223851:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223858:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d42044600/0xb29fc47e1a29135a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291361 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.223861:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910991872:0@lo:103: 00010000:00010000:1.0:1788925192.223871:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788925192.223875:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223880:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044c00 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:1.0:1788925192.223883:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.223897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925192.223901:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925192.223908:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925192.223913:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788925192.223924:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223930:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788925192.223936:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910991872 00000100:00100000:3.0:1788925192.223939:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910991872 00010000:00010000:1.0:1788925192.223941:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.223955:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29135a expref: 17 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223957:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d42044c00/0xb29fc47e1a291330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291337 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.223967:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788925192.223969:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.223975:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788925192.223975:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8c600 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:1.0:1788925192.223979:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.223980:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+17:3305:x1875823910991872:12345-0@lo:103: 00010000:00010000:1.0:1788925192.223985:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.223989:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:1.0:1788925192.223991:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925192.223996:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925192.223998:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29135a expref: 17 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224007:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.224008:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a29135a expref: 17 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224013:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788925192.224018:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224023:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c600/0xb29fc47e1a291314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29131b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.224025:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788925192.224032:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925192.224040:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224045:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8ca00 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:1.0:1788925192.224048:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.224051:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+17:3305:x1875823910991872:12345-0@lo:103: Request processed in 71us (164us total) trans 0 rc 0/0 00010000:00010000:1.0:1788925192.224055:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.224057:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:00010000:1.0:1788925192.224061:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925192.224066:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788925192.224074:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910992000:0@lo:103: 00010000:00010000:1.0:1788925192.224078:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224083:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788925192.224088:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.224093:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925192.224095:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8ca00/0xb29fc47e1a2912ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2912f1 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224121:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925192.224125:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224131:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00030000 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:1.0:1788925192.224134:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224150:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925192.224156:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925192.224162:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788925192.224176:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224182:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788925192.224188:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224204:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2912c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2912c7 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.224217:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925192.224219:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925192.224221:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925192.224241:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925192.224251:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910992128:0@lo:103: 00000100:00100000:3.0:1788925192.224419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.224463:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910992000 00000100:00100000:3.0:1788925192.224468:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910992000 00010000:00010000:3.0:1788925192.224482:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291330 expref: 17 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.224495:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910992128 00000100:00100000:3.0:1788925192.224497:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910992128 00010000:00010000:3.0:1788925192.224506:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291314 expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.224516:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925192.224521:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+18:3306:x1875823910992000:12345-0@lo:103: 00010000:00010000:3.0:1788925192.224528:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925192.224531:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291330 expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.224551:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a291330 expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.224561:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925192.224590:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+18:3306:x1875823910992000:12345-0@lo:103: Request processed in 69us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.224597:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925192.224610:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788925192.224615:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+17:3306:x1875823910992128:12345-0@lo:103: 00010000:00010000:3.0:1788925192.224623:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925192.224627:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291314 expref: 17 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.224635:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a291314 expref: 17 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.224645:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925192.224665:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+17:3306:x1875823910992128:12345-0@lo:103: Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.224671:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788925192.224692:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910992384:0@lo:103: 00000100:00100000:3.0:1788925192.224727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925192.224834:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925192.225023:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910991872:0@lo:103: 00000100:00100000:3.0:1788925192.225041:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925192.225046:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910992256:0@lo:103: 00000100:00100000:3.0:1788925192.225069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925192.225317:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a291361 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a29135a expref: 16 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925192.225331:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0ff800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991232:0@lo:104: 00010000:00010000:0.0:1788925192.225349:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d42044e00/0xb29fc47e1a291337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a291330 expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925192.225359:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991360:0@lo:104: 00010000:00010000:0.0:1788925192.225370:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d42045c00/0xb29fc47e1a29131b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a291314 expref: 14 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925192.225378:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991488:0@lo:104: 00000100:00100000:0.0:1788925192.225387:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991616:0@lo:104: 00000100:00100000:0.0:1788925192.225394:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1875823910991744:0@lo:104: 00010000:00010000:0.0:1788925192.225431:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.225645:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910992128:0@lo:103: 00000100:00100000:3.0:1788925192.225653:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910992000:0@lo:103: 00000100:00100000:2.0:1788925192.225960:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910992384 00000100:00100000:2.0:1788925192.225967:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910992384 00000100:00100000:1.0:1788925192.226081:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910992256 00000100:00100000:1.0:1788925192.226086:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910992256 00010000:00010000:1.0:1788925192.226109:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2912ea expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925192.226139:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925192.226147:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+15:3305:x1875823910992256:12345-0@lo:103: 00010000:00010000:1.0:1788925192.226157:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925192.226162:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2912ea expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.226179:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2912ea expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.226193:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d42045e00/0xb29fc47e1a2912f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2912ea expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.226204:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925192.226244:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+14:3305:x1875823910992256:12345-0@lo:103: Request processed in 99us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.226251:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788925192.226416:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910992256:0@lo:103: 00010000:00010000:3.0:1788925192.226480:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2912c0 expref: 13 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.226508:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925192.226514:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+13:3305:x1875823910992384:12345-0@lo:103: 00010000:00010000:3.0:1788925192.226522:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925192.226527:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2912c0 expref: 13 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226536:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2912c0 expref: 13 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226546:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2912c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2912c0 expref: 13 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226557:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226565:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226577:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226583:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226590:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226603:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226610:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed8a00 already unused, calling callback (ffffffffc141f230) 00010000:00010000:3.0:1788925192.226614:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.226621:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.227070:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.227080:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788925192.227089:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788925192.229841:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.229861:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07ed8a00/0xb29fc47e1a291376 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925192.229882:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925192.229969:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+12:3305:x1875823910992384:12345-0@lo:103: Request processed in 3452us (5238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.229979:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925192.230034:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823910992384:0@lo:103: 00010000:00010000:1.0:1788925192.256883:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925192.262107:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823910992512:0@lo:13: 00000100:00100000:1.0:1788925192.262189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925192.262272:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910992512 00000100:00100000:1.0:1788925192.262401:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910992512 00000100:00100000:1.0:1788925192.262459:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925192.262470:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823910992512:12345-0@lo:13: 00002000:00000024:1.0:1788925192.262505:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925192.262554:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823910992512:12345-0@lo:13: Request processed in 86us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.262562:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788925192.262601:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d06a9d180 x1875823910992512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925192.262620:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823910992512:0@lo:13: 00000100:00100000:1.0:1788925192.279627:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910991104:0@lo:253: 10000000:01000000:1.0:1788925192.279645:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788925192.279661:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788925192.279662:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788925192.279664:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925192.279665:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788925192.279666:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925192.279667:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925192.279670:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788925192.279671:0:7620:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788925192.279673:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925192.279674:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788925192.279696:0:7620:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e0d0b757000 from lustre-OST0001 10000000:01000000:1.0:1788925192.279721:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788925192.279723:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 00000100:00100000:3.0:1788925192.279802:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+11:7620:x1875823910991104:12345-0@lo:253: Request processed in 75568us (75880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.279813:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 10000000:01000000:1.0:1788925192.279898:0:7620:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e0d06a20000 local copy 10000000:01000000:1.0:1788925192.279902:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788925192.279937:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.279947:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.279957:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925192.279976:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910992640:0@lo:101: 00000100:00100000:1.0:1788925192.280010:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925192.280051:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a07240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925192.280109:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910992640 00000100:00100000:0.0:1788925192.280115:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910992640 00000100:00100000:0.0:1788925192.280187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788925192.280196:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+11:7620:x1875823910992640:12345-0@lo:101: 00010000:00010000:0.0:1788925192.280208:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925192.280220:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d00031000/0xb29fc47e1a291384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29137d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.280240:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d00031000/0xb29fc47e1a291384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29137d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.280250:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d00031000/0xb29fc47e1a291384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29137d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.280258:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00031000, rc 0) 00000100:00100000:0.0:1788925192.280474:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910992640:12345-0@lo:101: Request processed in 277us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925192.280481:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788925192.280540:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910992640:0@lo:101: 00010000:00010000:2.0:1788925192.280608:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.280617:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.280700:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910992768:0@lo:501: 00000100:00100000:2.0:1788925192.280844:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.280911:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d118e83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925192.280955:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910992768 00000100:00100000:3.0:1788925192.280959:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910992768 00000100:00100000:3.0:1788925192.281022:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788925192.281029:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910992768:12345-0@lo:501: 00000100:00100000:3.0:1788925192.281230:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910992768:12345-0@lo:501: Request processed in 201us (498us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925192.281237:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788925192.281304:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910992768:0@lo:501: 10000000:01000000:2.0:1788925192.281317:0:7620:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788925192.281342:0:7620:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788925192.281347:0:7620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.281355:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.281361:0:7620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.281390:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788925192.281408:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e0d0b757000 10000000:01000000:2.0:1788925192.281413:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788925192.281417:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788925192.281420:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788925192.281424:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788925192.281427:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788925192.281445:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.281453:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.281461:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.281472:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910992896:0@lo:101: 00000100:00100000:2.0:1788925192.281499:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925192.281554:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925192.281561:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.281567:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148a400 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925192.281571:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.281577:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925192.281590:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925192.281595:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925192.281614:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.281619:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925192.281637:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.281644:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a400/0xb29fc47e1a29137d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb29fc47e1a291384 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.281657:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925192.281658:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925192.281660:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925192.281671:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910993024:0@lo:103: 00000100:00100000:0.0:1788925192.281699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925192.281774:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910993024 00000100:00100000:0.0:1788925192.281779:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910993024 00000100:00100000:0.0:1788925192.281808:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788925192.281815:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+12:3307:x1875823910993024:12345-0@lo:103: 00010000:00010000:0.0:1788925192.281824:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925192.281836:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d00031000/0xb29fc47e1a291384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb29fc47e1a29137d expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.281849:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925192.281884:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+11:3307:x1875823910993024:12345-0@lo:103: Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925192.281906:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788925192.281948:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910993024:0@lo:103: 00000100:00100000:2.0:1788925192.282134:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d118e8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788925192.282172:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910992896 00000100:00100000:1.0:1788925192.282176:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910992896 00000100:00100000:0.0:1788925192.282218:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788925192.282225:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+11:7620:x1875823910992896:12345-0@lo:101: 00010000:00010000:0.0:1788925192.282234:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925192.282245:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29138b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.282261:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29138b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.282270:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29138b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.282277:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00031e00, rc 0) 00000100:00100000:0.0:1788925192.282313:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910992896:12345-0@lo:101: Request processed in 88us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925192.282319:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788925192.282411:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910992896:0@lo:101: 00010000:00010000:2.0:1788925192.282422:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.282431:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.282498:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993152:0@lo:501: 00000100:00100000:2.0:1788925192.282524:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.282544:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d118e8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925192.282587:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910993152 00000100:00100000:0.0:1788925192.282590:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910993152 00000100:00100000:0.0:1788925192.282616:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788925192.282622:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910993152:12345-0@lo:501: 00000100:00100000:0.0:1788925192.282837:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910993152:12345-0@lo:501: Request processed in 214us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925192.282843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788925192.282967:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993152:0@lo:501: 00000100:00100000:2.0:1788925192.282993:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993280:0@lo:503: 00000100:00100000:2.0:1788925192.283031:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.283056:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d118e8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925192.283402:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910993280 00000100:00100000:0.0:1788925192.283414:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910993280 00000100:00100000:0.0:1788925192.283446:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788925192.283453:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910993280:12345-0@lo:503: 00000100:00100000:0.0:1788925192.283797:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910993280:12345-0@lo:503: Request processed in 343us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925192.283805:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788925192.284004:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993280:0@lo:503: 00000040:00080000:2.0:1788925192.284261:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788925192.284329:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993408:0@lo:502: 00000100:00100000:2.0:1788925192.284368:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.284446:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d118e8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788925192.284511:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910993408 00000100:00100000:3.0:1788925192.284516:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910993408 00000100:00100000:3.0:1788925192.284540:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788925192.284547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910993408:12345-0@lo:502: 00000100:00100000:3.0:1788925192.284697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910993408:12345-0@lo:502: Request processed in 150us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.284703:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788925192.284781:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993408:0@lo:502: 00000040:00080000:2.0:1788925192.285033:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788925192.285081:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788925192.285113:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788925192.285162:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788925192.285198:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788925192.285230:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788925192.285264:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993536:0@lo:502: 00000100:00100000:2.0:1788925192.285301:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.285333:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d118e8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788925192.285395:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910993536 00000100:00100000:3.0:1788925192.285400:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910993536 00000100:00100000:3.0:1788925192.285420:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788925192.285427:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910993536:12345-0@lo:502: 00000100:00100000:3.0:1788925192.285559:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910993536:12345-0@lo:502: Request processed in 132us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.285565:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788925192.285642:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993536:0@lo:502: 00000040:00080000:2.0:1788925192.285716:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788925192.285725:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788925192.286174:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788925192.286183:0:7627:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788925192.286188:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925192.286191:0:7627:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788925192.286195:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925192.286209:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e0d105819b8) 00000020:00000080:2.0:1788925192.286228:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788925192.286233:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788925192.286286:0:7627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0d0b757000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788925192.286294:0:7627:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788925192.286302:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb29fc47e1a2913a0 00010000:00010000:2.0:1788925192.298328:0:7627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788925192.298636:0:7627:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788925192.304685:0:7627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788925192.305070:0:7627:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788925192.313375:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788925192.316944:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788925192.320132:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788925192.320144:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925192.320151:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925192.320153:0:7627:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788925192.320157:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925192.320161:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925192.320163:0:7627:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788925192.320165:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788925192.320167:0:7627:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788925192.320220:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925192.320229:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925192.320230:0:7627:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788925192.320234:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788925192.329622:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788925192.329659:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788925192.329685:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.329698:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925192.329731:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d0b757000 from 1 10000000:01000000:2.0:1788925192.329734:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788925192.329789:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.329798:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.329808:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.329830:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993664:0@lo:101: 00000100:00100000:2.0:1788925192.329904:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.329947:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925192.330053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910993664 00000100:00100000:1.0:1788925192.330061:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910993664 00000100:00100000:1.0:1788925192.330104:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788925192.330112:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+12:7620:x1875823910993664:12345-0@lo:101: 00010000:00010000:1.0:1788925192.330133:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925192.330144:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2913a7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.330167:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2913a7 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.330175:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913a7 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.330183:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148ae00, rc 0) 00000100:00100000:1.0:1788925192.330225:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910993664:12345-0@lo:101: Request processed in 113us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.330232:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788925192.330550:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993664:0@lo:101: 00010000:00010000:2.0:1788925192.330565:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.330573:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.330658:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993792:0@lo:501: 00000100:00100000:2.0:1788925192.330685:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.330720:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925192.331562:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910993792 00000100:00100000:1.0:1788925192.331569:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910993792 00000100:00100000:1.0:1788925192.331609:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788925192.331617:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910993792:12345-0@lo:501: 00000100:00100000:1.0:1788925192.331872:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910993792:12345-0@lo:501: Request processed in 254us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.331879:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788925192.332853:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993792:0@lo:501: 00000100:00100000:2.0:1788925192.332914:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993920:0@lo:503: 00000100:00100000:2.0:1788925192.332975:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.333011:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925192.336589:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910993920 00000100:00100000:1.0:1788925192.336604:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910993920 00000100:00100000:1.0:1788925192.336667:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788925192.336678:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910993920:12345-0@lo:503: 00000100:00100000:1.0:1788925192.337080:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910993920:12345-0@lo:503: Request processed in 403us (4104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.337088:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788925192.337575:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910993920:0@lo:503: 00000040:00080000:2.0:1788925192.337885:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788925192.337977:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994048:0@lo:502: 00000100:00100000:2.0:1788925192.338027:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.338058:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925192.338135:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910994048 00000100:00100000:3.0:1788925192.338140:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910994048 00000100:00100000:3.0:1788925192.338172:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788925192.338180:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910994048:12345-0@lo:502: 00000100:00100000:3.0:1788925192.338342:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910994048:12345-0@lo:502: Request processed in 162us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.338349:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788925192.338538:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994048:0@lo:502: 00000040:00080000:2.0:1788925192.346682:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788925192.346806:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788925192.346856:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994176:0@lo:502: 00000100:00100000:2.0:1788925192.346956:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.347004:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925192.351249:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910994176 00000100:00100000:1.0:1788925192.351262:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910994176 00000100:00100000:1.0:1788925192.351329:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788925192.351340:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910994176:12345-0@lo:502: 00000100:00100000:1.0:1788925192.351613:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910994176:12345-0@lo:502: Request processed in 274us (4657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.351620:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788925192.353169:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994176:0@lo:502: 00000040:00080000:2.0:1788925192.353345:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788925192.353364:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788925192.353975:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925192.353984:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925192.353986:0:7631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788925192.353992:0:7631:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0d0b757000 00000020:00000080:1.0:1788925192.353995:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788925192.354014:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925192.354017:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925192.354019:0:7631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788925192.354021:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788925192.354146:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788925192.354167:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788925192.354187:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.354199:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925192.354235:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788925192.354238:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e0d0b757000 10000000:01000000:2.0:1788925192.354240:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e0d0b757000 10000000:01000000:2.0:1788925192.354253:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788925192.354258:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e0d0b757000 from 1 10000000:01000000:2.0:1788925192.354261:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788925192.354290:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.354298:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.354308:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.354328:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994304:0@lo:101: 00000100:00100000:2.0:1788925192.354385:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.354421:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788925192.354481:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910994304 00000100:00100000:1.0:1788925192.354488:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910994304 00000100:00100000:1.0:1788925192.354530:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788925192.354540:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910994304:12345-0@lo:101: 00010000:00010000:1.0:1788925192.354552:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925192.354565:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2913b5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.354585:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2913b5 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.354595:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913b5 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.354603:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148b800, rc 0) 00000100:00100000:1.0:1788925192.354649:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910994304:12345-0@lo:101: Request processed in 110us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.354655:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788925192.355061:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994304:0@lo:101: 00010000:00010000:2.0:1788925192.355075:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.355083:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.355151:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994432:0@lo:501: 00000100:00100000:2.0:1788925192.355180:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.355209:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788925192.355256:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910994432 00000100:00100000:0.0:1788925192.355261:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910994432 00000100:00100000:0.0:1788925192.355292:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788925192.355300:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910994432:12345-0@lo:501: 00000100:00100000:0.0:1788925192.355527:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910994432:12345-0@lo:501: Request processed in 226us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925192.355533:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788925192.355675:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994432:0@lo:501: 00000100:00100000:2.0:1788925192.355700:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994560:0@lo:503: 00000100:00100000:2.0:1788925192.355738:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.355793:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788925192.355852:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910994560 00000100:00100000:1.0:1788925192.355857:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910994560 00000100:00100000:1.0:1788925192.355883:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788925192.355902:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910994560:12345-0@lo:503: 00000100:00100000:1.0:1788925192.356047:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910994560:12345-0@lo:503: Request processed in 147us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.356055:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788925192.356202:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994560:0@lo:503: 00000040:00080000:2.0:1788925192.356487:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788925192.356547:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994688:0@lo:502: 00000100:00100000:2.0:1788925192.356582:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.356611:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788925192.356712:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910994688 00000100:00100000:1.0:1788925192.356716:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910994688 00000100:00100000:1.0:1788925192.356771:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788925192.356780:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910994688:12345-0@lo:502: 00000100:00100000:1.0:1788925192.356962:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910994688:12345-0@lo:502: Request processed in 182us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.356969:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788925192.357051:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994688:0@lo:502: 00000040:00080000:3.0:1788925192.357289:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788925192.357335:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788925192.357369:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788925192.357412:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788925192.357464:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788925192.357515:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788925192.357554:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788925192.357585:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788925192.357633:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788925192.357671:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788925192.357703:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788925192.357801:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788925192.357842:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788925192.357873:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788925192.357931:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788925192.357967:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788925192.358001:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788925192.358048:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788925192.358083:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788925192.358113:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788925192.358172:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788925192.358208:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788925192.358238:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788925192.358284:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788925192.358319:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788925192.358350:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788925192.358396:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788925192.358447:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788925192.358482:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788925192.358541:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788925192.358579:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788925192.358608:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788925192.358638:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788925192.358679:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788925192.358711:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788925192.358793:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788925192.358831:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788925192.358868:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994816:0@lo:502: 00000100:00100000:3.0:1788925192.358939:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.358980:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910994816 00000100:00100000:3.0:1788925192.358985:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910994816 00000100:00100000:3.0:1788925192.359015:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788925192.359022:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910994816:12345-0@lo:502: 00000100:00100000:0.0:1788925192.360611:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d32d549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925192.364193:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910994816:12345-0@lo:502: Request processed in 5161us (5245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.364206:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788925192.364617:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910994816:0@lo:502: 00000040:00080000:0.0:1788925192.364730:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788925192.364776:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788925192.365339:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788925192.365353:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e0d3f5919b8) 00000020:00000080:0.0:1788925192.365373:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788925192.365442:0:7632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e0d0b757000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788925192.365458:0:7632:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e0d0b757000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788925192.365460:0:7632:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e0d0b757000 3 00010000:00080000:0.0:1788925192.365486:0:7632:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0d3f85a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.104@tcp at head 00010000:00010000:0.0:1788925192.367085:0:7632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788925192.367269:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788925192.367301:0:7632:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788925192.367312:0:7632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb29fc47e1a2913ca 00000100:00080000:0.0:1788925192.367328:0:7632:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788925192.367333:0:7632:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e0d3f85a800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:0.0:1788925192.367377:0:7632:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0d2e7e1880 x1875823910994944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788925192.367394:0:7632:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788925192.367567:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875823910994944:0@lo:38: 00000100:00100000:2.0:1788925192.367635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.372118:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823910995200:0@lo:400: 00000100:00100000:3.0:1788925192.372182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.372219:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925192.372225:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823910995072:0@lo:400: 00000100:00100000:3.0:1788925192.372259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.372289:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910994944 00000100:00100000:3.0:1788925192.372297:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910994944 00000100:00100000:3.0:1788925192.372326:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910995200 00000100:00100000:3.0:1788925192.372329:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910995200 00000100:00100000:3.0:1788925192.372349:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910995072 00000100:00100000:3.0:1788925192.372352:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910995072 00000100:00100000:3.0:1788925192.372367:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925192.372375:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823910995200:12345-0@lo:400: 00000100:00100000:3.0:1788925192.372427:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823910995200:12345-0@lo:400: Request processed in 52us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.372434:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925192.372463:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925192.372471:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823910995072:12345-0@lo:400: 00000100:00100000:3.0:1788925192.372500:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823910995072:12345-0@lo:400: Request processed in 31us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.372506:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925192.372518:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925192.372522:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3303:x1875823910994944:12345-0@lo:38: 00010000:00080000:3.0:1788925192.372543:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1788925192.372576:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb29fc47e1a2913d1 00000004:00100000:3.0:1788925192.372592:0:6700:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788925192.372623:0:6700:0:(import.c:65:import_set_state_nolock()) ffff9e0d3f53e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788925192.372666:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875823910994944:12345-0@lo:38: Request processed in 142us (5031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.372673:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788925192.372713:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d3ffc2d80 x1875823910995072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925192.372734:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823910995072:0@lo:400: 00010000:00080000:3.0:1788925192.372779:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d3ffc2680 x1875823910995200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925192.372786:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823910995200:0@lo:400: 00010000:00080000:3.0:1788925192.372820:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d2e7e1880 x1875823910994944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925192.372828:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788925192.372834:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788925192.372841:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788925192.372845:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788925192.372847:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e0d3f85a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788925192.372852:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875823910994944:0@lo:38: 00000040:00080000:3.0:1788925192.373036:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1788925192.373166:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7633:1875823910995328:0@lo:901: 00000100:00100000:3.0:1788925192.373196:0:7633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925192.373227:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910995328 00000100:00100000:3.0:1788925192.373231:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910995328 00000100:00100000:3.0:1788925192.373264:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925192.373270:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1875823910995328:12345-0@lo:901: 00000100:00100000:3.0:1788925192.373615:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1875823910995328:12345-0@lo:901: Request processed in 344us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925192.373622:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788925192.373639:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925192.373650:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a04d80 going to sleep for 11 seconds 00010000:00080000:3.0:1788925192.373671:0:7633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e0d3ffc2680 x1875823910995328/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788925208 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925192.373681:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7633:1875823910995328:0@lo:901: 00000020:01000000:2.0:1788925192.373959:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788925192.373991:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788925192.374014:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.374026:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788925192.374067:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788925192.374069:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788925192.374071:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925192.374072:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925192.374074:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925192.374075:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925192.374076:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925192.374078:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925192.374079:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925192.374081:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925192.374083:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788925192.374087:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788925192.374089:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788925192.374091:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788925192.374092:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925192.374093:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925192.374094:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925192.374101:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925192.374102:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925192.374103:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925192.374104:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925192.374105:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925192.374106:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788925192.374121:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788925192.374131:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910995456:0@lo:253: 00000100:00100000:2.0:1788925192.374168:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.374202:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925192.375657:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910995456 00000100:00100000:1.0:1788925192.375668:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910995456 00000100:00100000:1.0:1788925192.375724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788925192.375733:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:7620:x1875823910995456:12345-0@lo:253: 20000000:01000000:1.0:1788925192.375785:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788925192.375799:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788925192.413860:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788925192.413874:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788925192.413907:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788925192.413912:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788925192.413934:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.413952:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291322 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.413961:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.413999:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a291322 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.414013:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a291322 expref: 14 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925192.414027:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875823910995584:0@lo:104: 00000100:00100000:2.0:1788925192.414094:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925192.414309:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d187edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925192.414333:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910995584 00000100:00100000:2.0:1788925192.414352:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910995584 00000100:00100000:2.0:1788925192.414443:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788925192.414462:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:5854:x1875823910995584:12345-0@lo:104: 00010000:00010000:2.0:1788925192.414473:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925192.414525:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788925192.414532:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:5854:x1875823910995584:12345-0@lo:104: Request processed in 72us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925192.414538:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788925192.414962:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925192.414971:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.414980:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00030400 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925192.414984:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.414993:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925192.414999:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925192.415006:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925192.415042:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.415049:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925192.415065:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.415073:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d00030400/0xb29fc47e1a291322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291329 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925192.415239:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875823910995584:0@lo:104: 00010000:00010000:3.0:1788925192.415263:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.416798:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925192.416806:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925192.416808:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925192.416830:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910995712:0@lo:103: 00000100:00100000:0.0:1788925192.416906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925192.416966:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910995712 00000100:00100000:0.0:1788925192.416972:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910995712 00010000:00010000:0.0:1788925192.417001:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291322 expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925192.417029:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788925192.417037:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d085fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+15:3306:x1875823910995712:12345-0@lo:103: 00010000:00010000:0.0:1788925192.417050:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925192.417055:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291322 expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.417067:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a291322 expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.417082:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d42045800/0xb29fc47e1a291329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a291322 expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.417099:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.417240:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788925192.417258:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005431569s 00010000:00010000:0.0:1788925192.417275:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.417282:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.417290:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.417296:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.417302:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9800 already unused, calling callback (ffffffffc141f230) 00010000:00010000:0.0:1788925192.417306:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.417314:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.418998:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925192.419016:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.419338:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.419350:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a2913d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925192.419368:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925192.419455:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d085fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+14:3306:x1875823910995712:12345-0@lo:103: Request processed in 2407us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925192.419466:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788925192.419623:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823910995712:0@lo:103: 00000100:00100000:1.0:1788925192.442053:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:7620:x1875823910995456:12345-0@lo:253: Request processed in 66311us (67873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925192.442069:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788925192.442328:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:76f68b46-a017-4297-a662-44212e04e46d:7620:1875823910995456:0@lo:253: 10000000:01000000:2.0:1788925192.442344:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788925192.442347:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788925192.442348:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788925192.442349:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925192.442350:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925192.442351:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925192.442352:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925192.442354:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925192.442356:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788925192.442357:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788925192.442358:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925192.442360:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788925192.442377:0:7620:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788925192.450520:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925192.450674:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788925192.450878:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925192.451047:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788925192.452577:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788925192.453208:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788925192.455027:0:7620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788925192.741398:0:7620:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788925192.741406:0:7620:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788925192.741568:0:7620:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788925192.741631:0:7620:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788925192.741646:0:7620:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788925192.741684:0:7620:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788925193.283798:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925194.305433:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925195.330239:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925196.357946:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925197.376906:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925197.377162:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823910996096:0@lo:400: 00000100:00100000:2.0:1788925197.377162:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910995840:0@lo:400: 00000100:00100000:1.0:1788925197.377516:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823910995968:0@lo:400: 00000100:00100000:1.0:1788925197.378720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925197.378803:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823910996480:0@lo:13: 00000100:00100000:1.0:1788925197.378833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925197.378884:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910995968 00000100:00100000:1.0:1788925197.378891:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910995968 00000100:00100000:1.0:1788925197.378948:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788925197.378968:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823910995968:12345-0@lo:400: 00000100:00100000:1.0:1788925197.379025:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823910995968:12345-0@lo:400: Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925197.379032:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788925197.379056:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910996480 00000100:00100000:1.0:1788925197.379059:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910996480 00000100:00100000:1.0:1788925197.379094:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925197.379101:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823910996480:12345-0@lo:13: 00002000:00000024:1.0:1788925197.379128:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925197.379144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788925197.381767:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc2a00 x1875823910995968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925197.381787:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823910995968:0@lo:400: 00000100:00080000:0.0:1788925197.383563:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925197.384193:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823910996480:12345-0@lo:13: Request processed in 5087us (5354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925197.384204:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788925197.384266:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2e7e3480 x1875823910996480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925197.384310:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823910996480:0@lo:13: 00000100:00100000:2.0:1788925197.385329:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823910996352:0@lo:400: 00000100:00100000:2.0:1788925197.385392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925197.385421:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925197.385428:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823910996224:0@lo:400: 00000100:00100000:2.0:1788925197.385451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925197.385492:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910995840 00000100:00100000:2.0:1788925197.385499:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910995840 00000100:00100000:2.0:1788925197.385543:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788925197.385553:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:3307:x1875823910995840:12345-0@lo:400: 00000100:00100000:2.0:1788925197.385604:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:3307:x1875823910995840:12345-0@lo:400: Request processed in 53us (6459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925197.385611:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788925197.385647:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910996224 00000100:00100000:2.0:1788925197.385651:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910996224 00000100:00100000:2.0:1788925197.385676:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788925197.385682:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823910996224:12345-0@lo:400: 00000100:00100000:2.0:1788925197.385710:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823910996224:12345-0@lo:400: Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925197.385716:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788925197.385764:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc0380 x1875823910996224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925197.385793:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823910996224:0@lo:400: 00000100:00100000:2.0:1788925197.385804:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823910995840:0@lo:400: 00000100:00100000:0.0:1788925197.385897:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910996352 00000100:00100000:0.0:1788925197.385902:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910996352 00000100:00100000:0.0:1788925197.385945:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925197.385952:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823910996352:12345-0@lo:400: 00000100:00100000:0.0:1788925197.385989:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823910996352:12345-0@lo:400: Request processed in 38us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925197.385995:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788925197.386090:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788925197.386111:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1880 x1875823910996352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925197.386120:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823910996352:0@lo:400: 00000100:00100000:3.0:1788925197.387925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925197.388239:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910996096 00000100:00100000:1.0:1788925197.388247:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910996096 00000100:00100000:1.0:1788925197.388296:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788925197.388304:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823910996096:12345-0@lo:400: 00000100:00100000:1.0:1788925197.388359:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823910996096:12345-0@lo:400: Request processed in 56us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925197.388365:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788925197.388404:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc3100 x1875823910996096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925197.388427:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823910996096:0@lo:400: 00000100:00080000:2.0:1788925197.390125:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925198.401125:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788925198.401161:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788925198.401165:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e0d04b8b800 from 30 10000000:01000000:3.0:1788925198.401170:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788925198.401215:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.401225:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925198.401235:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925198.401255:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910996608:0@lo:101: 00000100:00100000:3.0:1788925198.401321:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925198.401363:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f845600 going to sleep for 11 seconds 00000100:00100000:1.0:1788925198.401415:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910996608 00000100:00100000:1.0:1788925198.401421:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910996608 00000100:00100000:1.0:1788925198.401472:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788925198.401482:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823910996608:12345-0@lo:101: 00010000:00010000:1.0:1788925198.401495:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925198.401506:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2913df expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925198.401528:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2913df expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925198.401538:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913df expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925198.401547:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148a200, rc 0) 00000100:00100000:1.0:1788925198.401599:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910996608:12345-0@lo:101: Request processed in 119us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.401606:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788925198.401645:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910996608:0@lo:101: 00010000:00010000:1.0:1788925198.401658:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925198.401666:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925198.401710:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910996736:0@lo:501: 00000100:00100000:1.0:1788925198.401731:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.401763:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d101716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925198.401775:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910996736 00000100:00100000:1.0:1788925198.401778:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910996736 00000100:00100000:1.0:1788925198.401801:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788925198.401807:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910996736:12345-0@lo:501: 00000100:00100000:1.0:1788925198.402193:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910996736:12345-0@lo:501: Request processed in 385us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.402200:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788925198.402226:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910996736:0@lo:501: 00000100:00100000:1.0:1788925198.402250:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910996864:0@lo:503: 00000100:00100000:1.0:1788925198.402284:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.402296:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d101716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925198.402304:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910996864 00000100:00100000:1.0:1788925198.402307:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910996864 00000100:00100000:1.0:1788925198.402320:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788925198.402329:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910996864:12345-0@lo:503: 00000100:00100000:1.0:1788925198.402569:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910996864:12345-0@lo:503: Request processed in 238us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.402576:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788925198.402612:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910996864:0@lo:503: 00000100:00100000:1.0:1788925198.402792:0:7952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7952:1875823910996992:0@lo:502: 00000100:00100000:1.0:1788925198.402827:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.402864:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910996992 00000100:00100000:1.0:1788925198.402868:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910996992 00000100:00100000:1.0:1788925198.402890:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788925198.402896:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:7952:x1875823910996992:12345-0@lo:502: 00000100:00100000:1.0:1788925198.403734:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:7952:x1875823910996992:12345-0@lo:502: Request processed in 834us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.403888:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788925198.403937:0:7952:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10171b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788925198.403954:0:7952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7952:1875823910996992:0@lo:502: 00000100:00100000:1.0:1788925198.404079:0:7952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7952:1875823910997120:0@lo:502: 00000100:00100000:1.0:1788925198.404122:0:7952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.404181:0:7952:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10171b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925198.404269:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910997120 00000100:00100000:3.0:1788925198.404275:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910997120 00000100:00100000:3.0:1788925198.404417:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788925198.404427:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:7952:x1875823910997120:12345-0@lo:502: 00000100:00100000:3.0:1788925198.404638:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:7952:x1875823910997120:12345-0@lo:502: Request processed in 213us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925198.404644:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788925198.404808:0:7952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7952:1875823910997120:0@lo:502: 00000040:00080000:2.0:1788925198.404832:0:7952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788925198.404985:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788925198.405013:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788925198.405023:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925198.405033:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925198.405054:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788925198.405056:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788925198.405059:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788925198.405086:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925198.405093:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925198.405101:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925198.405115:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910997248:0@lo:101: 00000100:00100000:1.0:1788925198.405146:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.405182:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10171600 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.405328:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910997248 00000100:00100000:2.0:1788925198.405334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910997248 00000100:00100000:2.0:1788925198.405369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788925198.405377:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823910997248:12345-0@lo:101: 00010000:00010000:2.0:1788925198.405387:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925198.405398:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2913ed expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.405418:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2913ed expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.405429:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913ed expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.405437:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed8e00, rc 0) 00000100:00100000:2.0:1788925198.405472:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910997248:12345-0@lo:101: Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.405478:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788925198.405547:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910997248:0@lo:101: 00010000:00010000:1.0:1788925198.405558:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925198.405566:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925198.405604:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910997376:0@lo:501: 00000100:00100000:1.0:1788925198.405625:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.405647:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10171600 going to sleep for 11 seconds 00000100:00100000:1.0:1788925198.405658:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910997376 00000100:00100000:1.0:1788925198.405661:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910997376 00000100:00100000:1.0:1788925198.405677:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788925198.405690:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910997376:12345-0@lo:501: 00000100:00100000:0.0:1788925198.406030:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910997376:0@lo:501: 00000100:00100000:1.0:1788925198.406065:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910997376:12345-0@lo:501: Request processed in 308us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925198.406065:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910997504:0@lo:503: 00000100:00100000:1.0:1788925198.406076:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788925198.406115:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.406161:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910997504 00000100:00100000:2.0:1788925198.406165:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910997504 00000100:00100000:2.0:1788925198.406183:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788925198.406189:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910997504:12345-0@lo:503: 00000100:00100000:0.0:1788925198.406211:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.406484:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910997504:12345-0@lo:503: Request processed in 293us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.406491:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788925198.406784:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910997504:0@lo:503: 00000100:00100000:2.0:1788925198.408467:0:7954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7954:1875823910997632:0@lo:502: 00000100:00100000:2.0:1788925198.408535:0:7954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.408605:0:7954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d35003300 going to sleep for 11 seconds 00000100:00100000:1.0:1788925198.408641:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910997632 00000100:00100000:1.0:1788925198.408648:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910997632 00000100:00100000:1.0:1788925198.408726:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788925198.408736:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:7954:x1875823910997632:12345-0@lo:502: 00000100:00100000:1.0:1788925198.409173:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:7954:x1875823910997632:12345-0@lo:502: Request processed in 438us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.409181:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788925198.409291:0:7954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7954:1875823910997632:0@lo:502: 00000020:01000000:3.0:1788925198.409322:0:7954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925198.409331:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925198.409333:0:7954:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788925198.409338:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788925198.409340:0:7954:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788925198.409360:0:7954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7954:1875823910997760:0@lo:502: 00000100:00100000:3.0:1788925198.409398:0:7954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.409551:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910997760 00000100:00100000:1.0:1788925198.409556:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910997760 00000100:00100000:1.0:1788925198.409577:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788925198.409583:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:7954:x1875823910997760:12345-0@lo:502: 00000100:00100000:1.0:1788925198.409726:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:7954:x1875823910997760:12345-0@lo:502: Request processed in 142us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.409732:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788925198.409910:0:7954:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f845780 going to sleep for 11 seconds 00000100:00100000:3.0:1788925198.409924:0:7954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7954:1875823910997760:0@lo:502: 00000020:01000000:3.0:1788925198.409944:0:7954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925198.409949:0:7954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925198.409951:0:7954:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788925198.409954:0:7954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788925198.411248:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788925198.411273:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788925198.411283:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.411294:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925198.411310:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788925198.411312:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e0d1882f800 from 30 10000000:01000000:0.0:1788925198.411315:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788925198.411342:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.411349:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.411358:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925198.411375:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910997888:0@lo:101: 00000100:00100000:0.0:1788925198.411425:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925198.411461:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.411505:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910997888 00000100:00100000:2.0:1788925198.411510:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910997888 00000100:00100000:2.0:1788925198.411552:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788925198.411560:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823910997888:12345-0@lo:101: 00010000:00010000:2.0:1788925198.411571:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925198.411582:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2913fb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.411603:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2913fb expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.411612:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913fb expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.411620:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed8600, rc 0) 00000100:00100000:2.0:1788925198.411660:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823910997888:12345-0@lo:101: Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.411666:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788925198.411732:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910997888:0@lo:101: 00010000:00010000:0.0:1788925198.411771:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.411781:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925198.411823:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998016:0@lo:501: 00000100:00100000:0.0:1788925198.411847:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925198.411884:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925198.411937:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910998016 00000100:00100000:3.0:1788925198.411941:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910998016 00000100:00100000:3.0:1788925198.411970:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788925198.411977:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823910998016:12345-0@lo:501: 00000100:00100000:3.0:1788925198.412254:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823910998016:12345-0@lo:501: Request processed in 277us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925198.412268:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788925198.412296:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998016:0@lo:501: 00000100:00100000:3.0:1788925198.412321:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998144:0@lo:503: 00000100:00100000:3.0:1788925198.412353:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925198.412365:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f8453c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925198.412375:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910998144 00000100:00100000:3.0:1788925198.412379:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910998144 00000100:00100000:3.0:1788925198.412394:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788925198.412399:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823910998144:12345-0@lo:503: 00000100:00100000:3.0:1788925198.412529:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823910998144:12345-0@lo:503: Request processed in 128us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925198.412536:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788925198.412569:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998144:0@lo:503: 00000100:00100000:3.0:1788925198.412710:0:7955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7955:1875823910998272:0@lo:502: 00000100:00100000:3.0:1788925198.412737:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925198.412778:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910998272 00000100:00100000:3.0:1788925198.412782:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910998272 00000100:00100000:3.0:1788925198.412798:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788925198.412803:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:7955:x1875823910998272:12345-0@lo:502: 00000100:00100000:3.0:1788925198.412946:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:7955:x1875823910998272:12345-0@lo:502: Request processed in 142us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925198.412952:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788925198.412979:0:7955:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f8456c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925198.412990:0:7955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7955:1875823910998272:0@lo:502: 00000100:00100000:3.0:1788925198.414489:0:7955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7955:1875823910998400:0@lo:502: 00000100:00100000:3.0:1788925198.414546:0:7955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925198.414939:0:7955:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f8456c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.427246:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910998400 00000100:00100000:2.0:1788925198.427261:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910998400 00000100:00100000:2.0:1788925198.427330:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788925198.427341:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:7955:x1875823910998400:12345-0@lo:502: 00000100:00100000:2.0:1788925198.427630:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:7955:x1875823910998400:12345-0@lo:502: Request processed in 291us (13083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.427637:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788925198.428861:0:7955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7955:1875823910998400:0@lo:502: 00000040:00080000:2.0:1788925198.428906:0:7955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788925198.429250:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788925198.429271:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788925198.429282:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.429304:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925198.429315:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788925198.429317:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e0d1882f800 from 5 10000000:01000000:0.0:1788925198.429320:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788925198.429357:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00031c00/0xb29fc47e1a291409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.429365:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d00031c00/0xb29fc47e1a291409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.429375:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00031c00/0xb29fc47e1a291409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925198.429394:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998528:0@lo:101: 00000100:00100000:0.0:1788925198.429450:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925198.429492:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d114490c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.429600:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910998528 00000100:00100000:2.0:1788925198.429607:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910998528 00000100:00100000:2.0:1788925198.429655:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788925198.429666:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823910998528:12345-0@lo:101: 00010000:00010000:2.0:1788925198.429678:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925198.429692:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed8800/0xb29fc47e1a291410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291409 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.429713:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed8800/0xb29fc47e1a291410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291409 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.429724:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07ed8800/0xb29fc47e1a291410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291409 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.429732:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed8800, rc 0) 00000100:00100000:2.0:1788925198.429891:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823910998528:12345-0@lo:101: Request processed in 227us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.429898:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788925198.430262:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998528:0@lo:101: 00010000:00010000:0.0:1788925198.430275:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00031c00/0xb29fc47e1a291409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.430285:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00031c00/0xb29fc47e1a291409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925198.430334:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998656:0@lo:256: 00000100:00100000:0.0:1788925198.430367:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925198.430399:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d114490c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.432560:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910998656 00000100:00100000:2.0:1788925198.432574:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910998656 00000100:00100000:2.0:1788925198.432661:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788925198.432674:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823910998656:12345-0@lo:256: 20000000:01000000:2.0:1788925198.432696:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788925198.432713:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788925198.432716:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788925198.436523:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823910998656:12345-0@lo:256: Request processed in 3841us (6144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.436551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788925198.441630:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998656:0@lo:256: 10000000:01000000:2.0:1788925198.441703:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788925198.441713:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00031c00/0xb29fc47e1a291409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.441723:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d00031c00/0xb29fc47e1a291409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291410 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925198.441734:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788925198.441736:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788925198.441739:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788925198.441811:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.441820:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.441830:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925198.441857:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998784:0@lo:101: 00000100:00100000:2.0:1788925198.441918:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.441975:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d182b1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788925198.441982:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910998784 00000100:00100000:0.0:1788925198.441990:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910998784 00000100:00100000:0.0:1788925198.442035:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788925198.442044:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823910998784:12345-0@lo:101: 00010000:00010000:0.0:1788925198.442058:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925198.442070:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291417 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.442095:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291417 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.442106:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291417 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.442117:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00030600, rc 0) 00000100:00100000:0.0:1788925198.442159:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823910998784:12345-0@lo:101: Request processed in 116us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925198.442166:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788925198.443628:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998784:0@lo:101: 00010000:00010000:2.0:1788925198.443648:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.443678:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925198.443777:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998912:0@lo:501: 00000100:00100000:2.0:1788925198.443823:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.443859:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d182b1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788925198.443906:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910998912 00000100:00100000:0.0:1788925198.443913:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910998912 00000100:00100000:0.0:1788925198.443960:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788925198.443973:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823910998912:12345-0@lo:501: 00000100:00100000:0.0:1788925198.444237:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823910998912:12345-0@lo:501: Request processed in 264us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925198.444245:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788925198.446338:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910998912:0@lo:501: 00000100:00100000:1.0:1788925198.446404:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910999040:0@lo:503: 00000100:00100000:1.0:1788925198.446487:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.446542:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10171cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925198.446578:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910999040 00000100:00100000:3.0:1788925198.446776:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910999040 00000100:00100000:3.0:1788925198.446830:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788925198.446839:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823910999040:12345-0@lo:503: 00000100:00100000:3.0:1788925198.449814:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823910999040:12345-0@lo:503: Request processed in 2968us (3319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925198.453152:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910999040:0@lo:503: 00000100:00100000:2.0:1788925198.454320:0:7960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7960:1875823910999168:0@lo:502: 00000100:00100000:2.0:1788925198.454402:0:7960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925198.454449:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910999168 00000100:00100000:2.0:1788925198.454450:0:7960:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d182b1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925198.454464:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910999168 00000100:00100000:3.0:1788925198.457498:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788925198.457883:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788925198.457898:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:7960:x1875823910999168:12345-0@lo:502: 00000100:00100000:0.0:1788925198.458249:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:7960:x1875823910999168:12345-0@lo:502: Request processed in 355us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925198.458256:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788925198.459219:0:7960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7960:1875823910999168:0@lo:502: 00000020:01000000:3.0:1788925198.459384:0:7960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788925198.459394:0:7960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788925198.459402:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925198.459405:0:7960:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788925198.459412:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788925198.459416:0:7960:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.104@tcp to nid 0x20000c0a8cb68 (192.168.203.104@tcp) 00000020:01000000:3.0:1788925198.459444:0:7960:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788925198.459447:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788925198.459465:0:7960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e0d0841b370) 00000020:00000080:3.0:1788925198.459490:0:7960:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788925198.459496:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788925198.459580:0:7960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788925198.459587:0:7960:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788925198.459594:0:7960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb29fc47e1a29142c 00010000:00080000:3.0:1788925198.459628:0:7960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e0d3b09a800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.104@tcp at head 00010000:00010000:3.0:1788925198.460522:0:7960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788925198.461422:0:7960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788925198.461445:0:7960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788925198.469323:0:7960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925198.471810:0:7960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925198.471921:0:7960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788925198.473560:0:7960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788925198.477687:0:7963:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788925198.477695:0:7963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788925198.478598:0:7960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788925198.478611:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788925198.478639:0:7960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788925198.478660:0:7960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb29fc47e1a291433 00000100:00080000:3.0:1788925198.478671:0:7960:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788925198.478676:0:7960:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e0d3b09a800 using connection 192.168.203.104@tcp/0@lo 00000100:00100000:3.0:1788925198.478710:0:7960:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e0d3ffc3b80 x1875823910999296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925198.478738:0:7960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788925198.478816:0:7960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925198.478820:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925198.478822:0:7960:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788925198.478824:0:7960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925198.478828:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925198.478830:0:7960:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788925198.478832:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788925198.478834:0:7960:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788925198.478871:0:7960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7960:1875823910999424:0@lo:502: 00000100:00100000:3.0:1788925198.478958:0:7960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925198.478998:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910999424 00000100:00100000:3.0:1788925198.479005:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910999424 00000100:00100000:3.0:1788925198.479049:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788925198.479058:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:7960:x1875823910999424:12345-0@lo:502: 00000100:00100000:3.0:1788925198.479273:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:7960:x1875823910999424:12345-0@lo:502: Request processed in 217us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925198.479290:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788925198.479334:0:7960:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f845600 going to sleep for 11 seconds 00000100:00100000:3.0:1788925198.479353:0:7960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:7960:1875823910999424:0@lo:502: 00000020:01000000:3.0:1788925198.479375:0:7960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925198.479379:0:7960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925198.479381:0:7960:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788925198.479384:0:7960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788925198.479444:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788925198.479474:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788925198.479484:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.479497:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925198.479506:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788925198.479509:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e0d06a20000 from 1 10000000:01000000:0.0:1788925198.479511:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788925198.479537:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.479545:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925198.479554:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925198.479568:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910999552:0@lo:101: 00000100:00100000:0.0:1788925198.479605:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925198.479627:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788925198.479674:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823910999680:0@lo:400: 00000100:00100000:1.0:1788925198.479708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.479778:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925198.479785:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911000064:0@lo:400: 00000100:00100000:1.0:1788925198.479814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.479847:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823910999808:0@lo:400: 00000100:00100000:1.0:1788925198.479879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.479900:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925198.479905:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823910999936:0@lo:400: 00000100:00100000:1.0:1788925198.479929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.479963:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910999680 00000100:00100000:1.0:1788925198.479968:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910999680 00000100:00100000:1.0:1788925198.480000:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911000064 00000100:00100000:1.0:1788925198.480003:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911000064 00000100:00100000:1.0:1788925198.480015:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910999808 00000100:00100000:1.0:1788925198.480018:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910999808 00000100:00100000:1.0:1788925198.480031:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788925198.480037:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823910999680:12345-0@lo:400: 00000100:00100000:1.0:1788925198.480077:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823910999680:12345-0@lo:400: Request processed in 40us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.480084:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788925198.480099:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788925198.480105:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911000064:12345-0@lo:400: 00000100:00100000:1.0:1788925198.480131:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911000064:12345-0@lo:400: Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.480137:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788925198.480149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788925198.480155:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823910999808:12345-0@lo:400: 00000100:00100000:1.0:1788925198.480183:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823910999808:12345-0@lo:400: Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.480196:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788925198.480224:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910999936 00000100:00100000:1.0:1788925198.480227:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910999936 00000100:00100000:1.0:1788925198.480251:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925198.480259:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823910999936:12345-0@lo:400: 00000100:00100000:1.0:1788925198.480292:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823910999936:12345-0@lo:400: Request processed in 34us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.480299:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788925198.480339:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d06a9fb80 x1875823910999936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925198.480351:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823910999936:0@lo:400: 00010000:00080000:1.0:1788925198.480367:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d06a9f100 x1875823910999808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925198.480374:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823910999808:0@lo:400: 00010000:00080000:1.0:1788925198.480400:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d06a9d500 x1875823911000064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925198.480409:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911000064:0@lo:400: 00010000:00080000:1.0:1788925198.480420:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d06a9d880 x1875823910999680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925198.480429:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823910999680:0@lo:400: 00000100:00100000:2.0:1788925198.480557:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875823910999296:0@lo:8: 00000100:00100000:2.0:1788925198.480593:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.480652:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910999552 00000100:00100000:2.0:1788925198.480656:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910999552 00000100:00100000:2.0:1788925198.480685:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788925198.480692:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823910999552:12345-0@lo:101: 00010000:00010000:2.0:1788925198.480700:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925198.480714:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29143a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.480735:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29143a expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.480779:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29143a expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.480789:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed8400, rc 0) 00000100:00100000:2.0:1788925198.480826:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823910999552:12345-0@lo:101: Request processed in 134us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925198.480838:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788925198.480891:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823910999552:0@lo:101: 00010000:00010000:2.0:1788925198.480905:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.480914:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925198.480966:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911000192:0@lo:501: 00000100:00100000:2.0:1788925198.480990:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.481013:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d182b1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.481025:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911000192 00000100:00100000:2.0:1788925198.481029:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911000192 00000100:00100000:2.0:1788925198.481053:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788925198.481058:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911000192:12345-0@lo:501: 00000100:00100000:2.0:1788925198.481283:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911000192:12345-0@lo:501: Request processed in 223us (290us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788925198.481291:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788925198.481320:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911000192:0@lo:501: 10000000:01000000:2.0:1788925198.481340:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788925198.481346:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925198.481355:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925198.485576:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823910999296 00000100:00100000:1.0:1788925198.485590:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823910999296 00000100:00100000:1.0:1788925198.485642:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788925198.485652:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1875823910999296:12345-0@lo:8: 00010000:00080000:1.0:1788925198.485691:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1788925198.485722:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb29fc47e1a291448 00002000:00100000:1.0:1788925198.485763:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e0d41ee3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788925198.485778:0:6678:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788925198.485782:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788925198.485919:0:6678:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788925198.486097:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788925198.486124:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9e0d41ee7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925198.486219:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875823910999296:12345-0@lo:8: Request processed in 568us (5625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.486226:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788925198.486288:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc3b80 x1875823910999296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788925208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925198.486299:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788925198.486306:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788925198.486314:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788925198.486318:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788925198.486320:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e0d3b09a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788925198.486333:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788925198.486338:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875823910999296:0@lo:8: 00000004:00080000:1.0:1788925198.486363:0:7963:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788925198.486479:0:7963:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 207413735063ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788925198.610766:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788925198.687602:0:7964:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788925198.687648:0:7964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1875823911000448:0@lo:7: 00000100:00100000:0.0:1788925198.687717:0:7964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925198.687934:0:7964:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d2f5e90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925198.688139:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911000320:0@lo:13: 00000100:00100000:1.0:1788925198.688173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.688217:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911000448 00000100:00100000:1.0:1788925198.688224:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911000448 00000100:00100000:1.0:1788925198.688297:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788925198.688307:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7964:x1875823911000448:12345-0@lo:7: 00000100:00100000:0.0:1788925198.688657:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911000320 00000100:00100000:0.0:1788925198.688662:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911000320 00000100:00100000:0.0:1788925198.688698:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788925198.688707:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875823911000320:12345-0@lo:13: 00002000:00000024:0.0:1788925198.688731:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:3.0:1788925198.688884:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925198.688947:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875823911000320:12345-0@lo:13: Request processed in 241us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925198.688955:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:02000400:0.0:1788925198.699222:0:7983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00080000:2.0:1788925198.699608:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2e7e1180 x1875823911000320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925198.699635:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911000320:0@lo:13: 00002000:00080000:1.0:1788925198.702214:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788925198.702222:0:6677:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788925198.702375:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7964:x1875823911000448:12345-0@lo:7: Request processed in 14067us (14654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.702386:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788925198.706064:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2e7e1880 x1875823911000448/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788925214 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925198.706084:0:7964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1875823911000448:0@lo:7: 00000004:00080000:2.0:1788925198.706100:0:7964:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788925198.712003:0:7964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1875823911000576:0@lo:5: 00000100:00100000:1.0:1788925198.712069:0:7964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925198.712130:0:7964:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0c027fad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.712212:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911000576 00000100:00100000:2.0:1788925198.712221:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911000576 00000100:00100000:2.0:1788925198.712278:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788925198.712287:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7964:x1875823911000576:12345-0@lo:5: 00002000:00080000:2.0:1788925198.712311:0:6676:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788925198.712315:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788925198.712648:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7964:x1875823911000576:12345-0@lo:5: Request processed in 361us (577us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788925198.712656:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788925198.712776:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d06a9d500 x1875823911000576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925214 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925198.712792:0:7964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1875823911000576:0@lo:5: 00000004:00080000:3.0:1788925198.712803:0:7964:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788925198.712831:0:7964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1875823911000704:0@lo:700: 00000100:00100000:3.0:1788925198.712866:0:7964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925198.712892:0:7964:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1a3e8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925198.713535:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911000704 00000100:00100000:2.0:1788925198.713543:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911000704 00000100:00100000:2.0:1788925198.713592:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925198.713602:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7964:x1875823911000704:12345-0@lo:700: 00000100:00100000:2.0:1788925198.713639:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1875823911000832:0@lo:700: 00000100:00100000:2.0:1788925198.713673:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925198.713702:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d0b71a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925198.713855:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911000832 00000100:00100000:0.0:1788925198.713860:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911000832 00000100:00100000:0.0:1788925198.713893:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788925198.713902:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1875823911000832:12345-0@lo:700: 40000000:02000000:0.0:1788925198.803657:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788925198.813244:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1875823911000832:12345-0@lo:700: Request processed in 99336us (99562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925198.813258:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788925198.813365:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3b0fed80 x1875823911000832/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788925214 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925198.813381:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1875823911000832:0@lo:700: 40000000:02000000:2.0:1788925198.813408:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1788925198.931547:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788925198.931578:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1788925198.933032:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7964:x1875823911000704:12345-0@lo:700: Request processed in 219425us (220157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925198.933050:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788925198.936315:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1500 x1875823911000704/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788925214 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925198.936329:0:7964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788925198.936346:0:7964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1875823911000704:0@lo:700: 00000004:02000040:2.0:1788925199.041993:0:7964:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788925199.047364:0:7964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1875823911000960:0@lo:5: 00000100:00100000:0.0:1788925199.047615:0:7964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925199.047709:0:7964:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d04fb0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925199.047957:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911000960 00000100:00100000:2.0:1788925199.047965:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911000960 00000100:00100000:2.0:1788925199.048010:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788925199.048020:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7964:x1875823911000960:12345-0@lo:5: 00002000:00080000:2.0:1788925199.054037:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788925199.054057:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788925199.062204:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7964:x1875823911000960:12345-0@lo:5: Request processed in 14177us (14581us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788925199.062216:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788925199.062826:0:7964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1500 x1875823911000960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925215 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925199.062844:0:7964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7964:1875823911000960:0@lo:5: 00000004:00080000:0.0:1788925199.062870:0:7964:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788925199.425407:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925200.450247:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925201.473606:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925202.497257:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925202.509206:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925202.509230:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911001088:0@lo:13: 00000100:00100000:3.0:1788925202.509299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925202.509416:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911001088 00000100:00100000:2.0:1788925202.509423:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911001088 00000100:00100000:2.0:1788925202.509479:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925202.509489:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911001088:12345-0@lo:13: 00002000:00000024:2.0:1788925202.509521:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925202.509565:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911001088:12345-0@lo:13: Request processed in 78us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925202.509573:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788925202.509606:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3b0fed80 x1875823911001088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925202.509624:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911001088:0@lo:13: 00000100:00080000:3.0:1788925202.509674:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925203.521160:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788925203.521243:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925203.521277:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911001600:0@lo:400: 00000100:00100000:0.0:1788925203.521278:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911001344:0@lo:400: 00000100:00100000:2.0:1788925203.521360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925203.521372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925203.521434:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911001472:0@lo:400: 00000100:00100000:2.0:1788925203.521462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925203.521532:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911001600 00000100:00100000:2.0:1788925203.521539:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911001600 00000100:00100000:2.0:1788925203.521582:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925203.521590:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911001600:12345-0@lo:400: 00000100:00100000:2.0:1788925203.521643:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911001600:12345-0@lo:400: Request processed in 53us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925203.521650:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925203.521673:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911001344 00000100:00100000:2.0:1788925203.521677:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911001344 00000100:00100000:2.0:1788925203.521700:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911001472 00000100:00100000:2.0:1788925203.521702:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911001472 00000100:00100000:2.0:1788925203.521726:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925203.521732:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911001344:12345-0@lo:400: 00000100:00100000:2.0:1788925203.521782:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911001344:12345-0@lo:400: Request processed in 50us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925203.521788:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925203.521799:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788925203.521805:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911001472:12345-0@lo:400: 00000100:00100000:2.0:1788925203.521858:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911001472:12345-0@lo:400: Request processed in 53us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925203.521865:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788925203.521995:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc3100 x1875823911001600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925203.522007:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911001216:0@lo:400: 00000100:00100000:2.0:1788925203.522027:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911001600:0@lo:400: 00000100:00100000:1.0:1788925203.522048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788925203.522058:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788925203.522074:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788925203.522097:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc3480 x1875823911001472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925203.522102:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911001216 00000100:00100000:1.0:1788925203.522108:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911001216 00000100:00100000:2.0:1788925203.522109:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911001472:0@lo:400: 00000100:00100000:1.0:1788925203.522144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788925203.522154:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911001216:12345-0@lo:400: 00000100:00100000:1.0:1788925203.522197:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911001216:12345-0@lo:400: Request processed in 45us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925203.522204:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788925203.522784:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788925203.522796:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911001856:0@lo:400: 00000100:00100000:2.0:1788925203.522842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925203.522870:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911001856 00000100:00100000:2.0:1788925203.522874:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911001856 00000100:00100000:2.0:1788925203.522909:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925203.522916:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875823911001856:12345-0@lo:400: 00000100:00100000:2.0:1788925203.522952:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875823911001856:12345-0@lo:400: Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925203.522959:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788925203.522973:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925203.522994:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823911001728:0@lo:400: 00010000:00080000:2.0:1788925203.522998:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc2680 x1875823911001856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925203.523012:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911001856:0@lo:400: 00000100:00100000:3.0:1788925203.523022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925203.523049:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911001728 00000100:00100000:3.0:1788925203.523052:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911001728 00000100:00100000:3.0:1788925203.523086:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788925203.523090:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823911001728:12345-0@lo:400: 00000100:00100000:3.0:1788925203.523123:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823911001728:12345-0@lo:400: Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925203.523127:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788925203.523131:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925203.523158:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911001216:0@lo:400: 00010000:00080000:1.0:1788925203.523179:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1880 x1875823911001728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925203.523191:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823911001728:0@lo:400: 00010000:00080000:0.0:1788925203.523599:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1180 x1875823911001344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925203.523610:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911001344:0@lo:400: 00000001:00080000:2.0:1788925203.768770:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788925204.035859:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911001984:0@lo:13: 00000100:00100000:2.0:1788925204.035935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925204.037342:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911001984 00000100:00100000:3.0:1788925204.037353:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911001984 00000100:00100000:3.0:1788925204.037413:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925204.037423:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911001984:12345-0@lo:13: 00002000:00000024:3.0:1788925204.037469:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925204.037539:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911001984:12345-0@lo:13: Request processed in 117us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925204.037545:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788925204.039165:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc3b80 x1875823911001984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925204.039188:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788925204.039211:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911001984:0@lo:13: 00000100:00100000:3.0:1788925204.372484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925204.372566:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892103296 00000100:00100000:2.0:1788925204.372576:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892103296 00000100:00100000:2.0:1788925204.372608:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:2.0:1788925204.372616:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2381:x1875823892103296:12345-192.168.203.4@tcp:250: 00010000:00080000:2.0:1788925204.372640:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 72a0672e-be75-4e81-8f5e-86be0fa2f83f@192.168.203.4@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1788925204.372679:0:5831:0:(genops.c:1385:class_connect()) connect: client 72a0672e-be75-4e81-8f5e-86be0fa2f83f, cookie 0xb29fc47e1a29144f 00000100:00080000:2.0:1788925204.372857:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9e0d2e594000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925204.372925:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+5:2381:x1875823892103296:12345-192.168.203.4@tcp:250: Request processed in 308us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925204.372934:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:2.0:1788925204.379374:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925204.379464:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892103424 00000100:00100000:3.0:1788925204.379482:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892103424 00000100:00100000:3.0:1788925204.379532:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:3.0:1788925204.379542:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+5:5610:x1875823892103424:12345-192.168.203.4@tcp:101: 00010000:00010000:3.0:1788925204.379567:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925204.379596:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd07 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925204.379624:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd07 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925204.379636:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd07 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925204.379646:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8de00, rc 0) 00000100:00100000:3.0:1788925204.379967:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+6:5610:x1875823892103424:12345-192.168.203.4@tcp:101: Request processed in 425us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925204.379974:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 114 00000100:00100000:1.0:1788925204.396533:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925204.396686:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892103552 00000100:00100000:2.0:1788925204.396696:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892103552 00000100:00100000:2.0:1788925204.396767:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:2.0:1788925204.396777:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+6:5610:x1875823892103552:12345-192.168.203.4@tcp:501: 00000100:00100000:2.0:1788925204.397378:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+6:5610:x1875823892103552:12345-192.168.203.4@tcp:501: Request processed in 593us (844us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788925204.397388:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 115 00000100:00100000:3.0:1788925204.400849:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925204.401077:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892103680 00000100:00100000:1.0:1788925204.401086:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892103680 00000100:00100000:1.0:1788925204.401266:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:1.0:1788925204.401277:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+6:5610:x1875823892103680:12345-192.168.203.4@tcp:101: 00010000:00010000:1.0:1788925204.401292:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925204.401311:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd0e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925204.401337:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd0e expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925204.401348:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd0e expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925204.401358:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148a800, rc 0) 00000100:00100000:1.0:1788925204.401411:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+7:5610:x1875823892103680:12345-192.168.203.4@tcp:101: Request processed in 136us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925204.401417:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 116 00000100:00100000:2.0:1788925204.411360:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925204.412365:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892103808 00000100:00100000:1.0:1788925204.412385:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892103808 00000100:00100000:1.0:1788925204.412442:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:1.0:1788925204.412453:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+7:5610:x1875823892103808:12345-192.168.203.4@tcp:501: 00000100:00100000:1.0:1788925204.412954:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:5610:x1875823892103808:12345-192.168.203.4@tcp:501: Request processed in 500us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925204.412963:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:2.0:1788925204.424612:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925204.424801:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892103936 00000100:00100000:2.0:1788925204.424811:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892103936 00000100:00100000:2.0:1788925204.424875:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:2.0:1788925204.424896:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:5610:x1875823892103936:12345-192.168.203.4@tcp:503: 00000100:00100000:2.0:1788925204.425616:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:5610:x1875823892103936:12345-192.168.203.4@tcp:503: Request processed in 719us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925204.425625:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 118 00000100:00100000:2.0:1788925204.439546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925204.439685:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892104064 00000100:00100000:3.0:1788925204.439694:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892104064 00000100:00100000:3.0:1788925204.439760:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:3.0:1788925204.439772:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:5628:x1875823892104064:12345-192.168.203.4@tcp:502: 00000100:00100000:3.0:1788925204.440220:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:5628:x1875823892104064:12345-192.168.203.4@tcp:502: Request processed in 448us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925204.440229:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 119 00000100:00100000:2.0:1788925204.481197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925204.481291:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892104192 00000100:00100000:0.0:1788925204.481300:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892104192 00000100:00100000:0.0:1788925204.481355:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:0.0:1788925204.481365:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:5628:x1875823892104192:12345-192.168.203.4@tcp:502: 00000100:00100000:0.0:1788925204.481642:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:5628:x1875823892104192:12345-192.168.203.4@tcp:502: Request processed in 277us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925204.481650:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 120 00000100:00100000:2.0:1788925204.492355:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925204.497882:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892104320 00000100:00100000:3.0:1788925204.497896:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892104320 00000100:00100000:3.0:1788925204.498052:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:3.0:1788925204.498062:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:5610:x1875823892104320:12345-192.168.203.4@tcp:101: 00010000:00010000:3.0:1788925204.498077:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925204.498093:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8d600/0xb29fc47e1a291464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd38 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925204.498135:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8d600/0xb29fc47e1a291464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd38 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925204.498147:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8d600/0xb29fc47e1a291464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd38 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925204.498157:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8d600, rc 0) 00000100:00100000:3.0:1788925204.498216:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5610:x1875823892104320:12345-192.168.203.4@tcp:101: Request processed in 156us (5872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925204.498223:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:1.0:1788925204.504087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925204.504564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892104448 00000100:00100000:3.0:1788925204.504574:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892104448 00000100:00100000:3.0:1788925204.504627:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:3.0:1788925204.504637:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5610:x1875823892104448:12345-192.168.203.4@tcp:256: 20000000:01000000:3.0:1788925204.504663:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788925204.504683:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788925204.504687:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788925204.504690:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788925204.504693:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788925204.514308:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5610:x1875823892104448:12345-192.168.203.4@tcp:256: Request processed in 9661us (10219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925204.514323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 122 00000100:00100000:2.0:1788925204.519770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925204.519959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892104576 00000100:00100000:3.0:1788925204.519968:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892104576 00000100:00100000:3.0:1788925204.520058:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:3.0:1788925204.520068:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5610:x1875823892104576:12345-192.168.203.4@tcp:101: 00010000:00010000:3.0:1788925204.520084:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925204.520100:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd3f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925204.520146:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd3f expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925204.520158:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd3f expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925204.520167:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8da00, rc 0) 00000100:00100000:3.0:1788925204.520220:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5610:x1875823892104576:12345-192.168.203.4@tcp:101: Request processed in 153us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925204.520227:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 123 00000100:00100000:2.0:1788925204.524458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925204.524599:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892104704 00000100:00100000:3.0:1788925204.524609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892104704 00000100:00100000:3.0:1788925204.524662:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:3.0:1788925204.524672:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5610:x1875823892104704:12345-192.168.203.4@tcp:501: 00000100:00100000:3.0:1788925204.524989:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5610:x1875823892104704:12345-192.168.203.4@tcp:501: Request processed in 317us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925204.524997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 124 00000100:00100000:2.0:1788925204.527769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925204.527848:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892104832 00000100:00100000:3.0:1788925204.527858:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892104832 00000100:00100000:3.0:1788925204.527908:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:3.0:1788925204.527918:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5610:x1875823892104832:12345-192.168.203.4@tcp:503: 00000100:00100000:3.0:1788925204.528277:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5610:x1875823892104832:12345-192.168.203.4@tcp:503: Request processed in 359us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925204.528285:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:2.0:1788925204.536738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925204.536855:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892104960 00000100:00100000:3.0:1788925204.536877:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892104960 00000100:00100000:3.0:1788925204.536936:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:3.0:1788925204.536946:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5631:x1875823892104960:12345-192.168.203.4@tcp:502: 00000100:00100000:3.0:1788925204.537196:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5631:x1875823892104960:12345-192.168.203.4@tcp:502: Request processed in 251us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925204.537205:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 126 00000100:00100000:3.0:1788925204.545855:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925204.545965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892105088 00000100:00100000:0.0:1788925204.545975:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892105088 00000100:00100000:0.0:1788925204.546031:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 127 00000100:00100000:0.0:1788925204.546041:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d101a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5631:x1875823892105088:12345-192.168.203.4@tcp:502: 00000100:00100000:0.0:1788925204.546264:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d101a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5631:x1875823892105088:12345-192.168.203.4@tcp:502: Request processed in 224us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925204.546273:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 127 00010000:00010000:2.0:1788925204.546542:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925204.552923:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925204.553016:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892105216 00000100:00100000:2.0:1788925204.553026:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892105216 00000100:00100000:2.0:1788925204.553074:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788925204.553082:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2381:x1875823892105216:12345-192.168.203.4@tcp:38: 00010000:00080000:2.0:1788925204.553110:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1788925204.553155:0:5839:0:(genops.c:1385:class_connect()) connect: client da20ab87-237b-453b-b2c0-9c81ec453d80, cookie 0xb29fc47e1a291472 00000004:00100000:2.0:1788925204.553185:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788925204.553191:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788925204.608287:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9e0d2e590800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925204.608359:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2381:x1875823892105216:12345-192.168.203.4@tcp:38: Request processed in 55275us (55443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925204.608369:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00010000:00010000:2.0:1788925205.568956:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925205.615296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925205.615881:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892105472 00000100:00100000:3.0:1788925205.615891:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892105472 00000100:00100000:3.0:1788925205.616014:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788925205.616025:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:5610:x1875823892105472:12345-192.168.203.4@tcp:41: 00000004:00000024:3.0:1788925205.616066:0:6700:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788925205.616132:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:5610:x1875823892105472:12345-192.168.203.4@tcp:41: Request processed in 109us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925205.616139:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788925205.616190:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925205.616270:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892105344 00000100:00100000:3.0:1788925205.616274:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892105344 00000100:00100000:3.0:1788925205.616297:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1788925205.616316:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:0:x1875823892105344:12345-192.168.203.4@tcp:41: 00000004:00000024:3.0:1788925205.616328:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788925205.616355:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:0:x1875823892105344:12345-192.168.203.4@tcp:41: Request processed in 40us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925205.616361:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1788925205.620242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925205.620292:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892105600 00000100:00100000:0.0:1788925205.620302:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892105600 00000100:00100000:0.0:1788925205.620368:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788925205.620379:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:5610:x1875823892105600:12345-192.168.203.4@tcp:40: 00000100:00100000:0.0:1788925205.620578:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:5610:x1875823892105600:12345-192.168.203.4@tcp:40: Request processed in 199us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925205.620585:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:0.0:1788925205.623925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925205.623978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925205.624259:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892105984 00000100:00100000:3.0:1788925205.624280:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892105984 00000100:00100000:3.0:1788925205.624328:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:3.0:1788925205.624336:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892105984:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1788925205.624401:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892105984:12345-192.168.203.4@tcp:400: Request processed in 65us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925205.624409:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 128 00000100:00100000:1.0:1788925205.624457:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892105728 00000100:00100000:1.0:1788925205.624462:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892105728 00000100:00100000:3.0:1788925205.624464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925205.624487:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892105856 00000100:00100000:1.0:1788925205.624490:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892105856 00000100:00100000:1.0:1788925205.624502:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1788925205.624508:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2381:x1875823892105728:12345-192.168.203.4@tcp:8: 00010000:00080000:1.0:1788925205.624532:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp t0 exp 0000000000000000 cur 214 last 0 00000100:00100000:3.0:1788925205.624553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000020:00000080:1.0:1788925205.624560:0:6677:0:(genops.c:1385:class_connect()) connect: client da20ab87-237b-453b-b2c0-9c81ec453d80, cookie 0xb29fc47e1a291479 00002000:00100000:1.0:1788925205.624572:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli da20ab87-237b-453b-b2c0-9c81ec453d80/ffff9e0d41ee5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788925205.624595:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788925205.624711:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892106112 00000100:00100000:0.0:1788925205.624715:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892106112 00000100:00100000:0.0:1788925205.624768:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788925205.624775:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:5610:x1875823892106112:12345-192.168.203.4@tcp:33: 00002000:00080000:1.0:1788925205.624952:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788925205.624981:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9e0d41ee2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925205.625018:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2381:x1875823892105728:12345-192.168.203.4@tcp:8: Request processed in 509us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925205.625026:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:1.0:1788925205.625040:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:1.0:1788925205.625045:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2381:x1875823892105856:12345-192.168.203.4@tcp:8: 00010000:00080000:1.0:1788925205.625060:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1788925205.625077:0:6677:0:(genops.c:1385:class_connect()) connect: client da20ab87-237b-453b-b2c0-9c81ec453d80, cookie 0xb29fc47e1a291480 00002000:00100000:1.0:1788925205.625082:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli da20ab87-237b-453b-b2c0-9c81ec453d80/ffff9e0d41ee4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788925205.625097:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788925205.625288:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788925205.625317:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9e0d41ee1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925205.625357:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2381:x1875823892105856:12345-192.168.203.4@tcp:8: Request processed in 311us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925205.625369:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:2.0:1788925205.625754:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788925205.672277:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 47073us 00000004:00200000:2.0:1788925205.691853:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788925205.692041:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:5610:x1875823892106112:12345-192.168.203.4@tcp:33: Request processed in 67261us (67481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925205.692056:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788925205.870589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925205.870671:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892106240 00000100:00100000:3.0:1788925205.870681:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892106240 00000100:00100000:3.0:1788925205.870737:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788925205.871052:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:5648:x1875823892106240:12345-192.168.203.4@tcp:101: 00010000:00010000:3.0:1788925205.871074:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925205.871099:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c000/0xb29fc47e1a291487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd69 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925205.871163:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ce00/0xb29fc47e1a29148e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925205.871177:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ce00/0xb29fc47e1a29148e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925205.871192:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ce00/0xb29fc47e1a29148e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925205.871462:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788925205.871467:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788925205.871547:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ce00/0xb29fc47e1a29148e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925205.871587:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c000/0xb29fc47e1a291487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd69 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925205.871605:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ce00/0xb29fc47e1a29148e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd69 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925205.871614:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ee00) 00010000:00010000:3.0:1788925205.871617:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788925205.871621:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8ce00, rc 0) 00000100:00100000:3.0:1788925205.871677:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+7:5648:x1875823892106240:12345-192.168.203.4@tcp:101: Request processed in 630us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925205.871684:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00010000:00010000:2.0:1788925206.592918:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925207.617030:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925207.617133:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911002112:0@lo:13: 00000100:00100000:3.0:1788925207.617213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925207.618120:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911002112 00000100:00100000:0.0:1788925207.618128:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911002112 00000100:00100000:0.0:1788925207.618238:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925207.618248:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911002112:12345-0@lo:13: 00002000:00000024:0.0:1788925207.618278:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925207.618332:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911002112:12345-0@lo:13: Request processed in 85us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925207.618338:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788925207.618542:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2e9dea00 x1875823911002112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925207.618560:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911002112:0@lo:13: 00000100:00080000:3.0:1788925207.619527:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788925207.646819:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da20ab87-237b-453b-b2c0-9c81ec453d80 00000100:00100000:1.0:1788925208.047055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925208.047269:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892106368 00000100:00100000:3.0:1788925208.047278:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892106368 00000100:00100000:3.0:1788925208.047369:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788925208.047379:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+7:5701:x1875823892106368:12345-192.168.203.4@tcp:41: 00000004:00000024:3.0:1788925208.047425:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788925208.047492:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+7:5701:x1875823892106368:12345-192.168.203.4@tcp:41: Request processed in 113us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925208.047499:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:2.0:1788925208.050081:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925208.050906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925208.051065:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892106496 00000100:00100000:3.0:1788925208.051075:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892106496 00000100:00100000:3.0:1788925208.051160:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788925208.051170:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da20ab87-237b-453b-b2c0-9c81ec453d80+5:5701:x1875823892106496:12345-192.168.203.4@tcp:13: 00002000:00000024:3.0:1788925208.051195:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925208.051259:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da20ab87-237b-453b-b2c0-9c81ec453d80+5:5701:x1875823892106496:12345-192.168.203.4@tcp:13: Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925208.051266:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00080000:2.0:1788925208.052121:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925208.055237:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925208.055324:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892106624 00000100:00100000:3.0:1788925208.055333:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892106624 00000100:00100000:3.0:1788925208.055418:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788925208.055428:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da20ab87-237b-453b-b2c0-9c81ec453d80+6:5701:x1875823892106624:12345-192.168.203.4@tcp:13: 00002000:00000024:3.0:1788925208.055465:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925208.055533:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:da20ab87-237b-453b-b2c0-9c81ec453d80+6:5701:x1875823892106624:12345-192.168.203.4@tcp:13: Request processed in 106us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925208.055539:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00080000:2.0:1788925208.058070:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788925208.640960:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925208.642428:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823911002240:0@lo:400: 00000100:00100000:3.0:1788925208.642495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925208.642540:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823911002752:0@lo:400: 00000100:00100000:3.0:1788925208.642577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925208.642605:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925208.642611:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911002624:0@lo:400: 00000100:00100000:3.0:1788925208.642635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925208.642663:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911002368:0@lo:400: 00000100:00100000:3.0:1788925208.642685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925208.642701:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911002880:0@lo:400: 00000100:00100000:3.0:1788925208.642720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925208.642762:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925208.642768:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875823911002496:0@lo:400: 00000100:00100000:3.0:1788925208.642802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925208.642835:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911002240 00000100:00100000:3.0:1788925208.642842:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911002240 00000100:00100000:3.0:1788925208.642884:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788925208.642893:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3307:x1875823911002240:12345-0@lo:400: 00000100:00100000:3.0:1788925208.642940:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3307:x1875823911002240:12345-0@lo:400: Request processed in 49us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925208.642947:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788925208.642976:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911002752 00000100:00100000:3.0:1788925208.642980:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911002752 00000100:00100000:3.0:1788925208.643013:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911002368 00000100:00100000:3.0:1788925208.643016:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911002368 00000100:00100000:3.0:1788925208.643027:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911002496 00000100:00100000:3.0:1788925208.643029:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911002496 00000100:00100000:3.0:1788925208.643042:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925208.643047:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823911002752:12345-0@lo:400: 00000100:00100000:3.0:1788925208.643079:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823911002752:12345-0@lo:400: Request processed in 31us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925208.643085:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925208.643098:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788925208.643103:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911002368:12345-0@lo:400: 00000100:00100000:3.0:1788925208.643135:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911002368:12345-0@lo:400: Request processed in 32us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925208.643140:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788925208.643151:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788925208.643156:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875823911002496:12345-0@lo:400: 00000100:00100000:3.0:1788925208.643192:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875823911002496:12345-0@lo:400: Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925208.643199:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788925208.643230:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911002624 00000100:00100000:3.0:1788925208.643234:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911002624 00000100:00100000:3.0:1788925208.643256:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911002880 00000100:00100000:3.0:1788925208.643259:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911002880 00000100:00100000:3.0:1788925208.643274:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925208.643279:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911002624:12345-0@lo:400: 00000100:00100000:3.0:1788925208.643307:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911002624:12345-0@lo:400: Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925208.643313:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925208.643323:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925208.643329:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911002880:12345-0@lo:400: 00000100:00100000:3.0:1788925208.643357:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911002880:12345-0@lo:400: Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925208.643363:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788925208.643389:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925208.643393:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925208.643425:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875823911002496:0@lo:400: 00000100:00100000:3.0:1788925208.643436:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911002368:0@lo:400: 00010000:00080000:3.0:1788925208.643446:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc3100 x1875823911002880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925208.643455:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911002880:0@lo:400: 00010000:00080000:3.0:1788925208.643483:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc2680 x1875823911002624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925208.643504:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911002624:0@lo:400: 00000100:00100000:3.0:1788925208.643515:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823911002240:0@lo:400: 00000100:00100000:3.0:1788925208.643525:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823911002752:0@lo:400: 00000100:00100000:3.0:1788925209.154080:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925209.154106:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911003008:0@lo:13: 00000100:00100000:3.0:1788925209.154175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925209.154242:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911003008 00000100:00100000:3.0:1788925209.154248:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911003008 00000100:00100000:3.0:1788925209.154293:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925209.154301:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911003008:12345-0@lo:13: 00002000:00000024:3.0:1788925209.154333:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925209.154373:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911003008:12345-0@lo:13: Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925209.154379:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788925209.154420:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2ea93480 x1875823911003008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925209.154437:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911003008:0@lo:13: 00010000:00010000:2.0:1788925209.664954:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788925209.722014:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da20ab87-237b-453b-b2c0-9c81ec453d80 00000001:00100000:0.0:1788925210.246052:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da20ab87-237b-453b-b2c0-9c81ec453d80 00000001:02000400:3.0:1788925210.358255:0:8292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788925210.688899:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925210.805988:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925210.806046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925210.806100:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925210.806137:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925210.806180:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892107008 00000100:00100000:3.0:1788925210.806212:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892107008 00000100:00100000:3.0:1788925210.806282:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892107136 00000100:00100000:3.0:1788925210.806286:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892107136 00000100:00100000:3.0:1788925210.806307:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788925210.806319:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2383:x1875823892107008:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1788925210.806584:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2383:x1875823892107008:12345-192.168.203.4@tcp:400: Request processed in 266us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925210.806593:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788925210.806621:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788925210.806629:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2383:x1875823892107136:12345-192.168.203.4@tcp:400: 00000100:00100000:2.0:1788925210.806662:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892106880 00000100:00100000:3.0:1788925210.806666:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2383:x1875823892107136:12345-192.168.203.4@tcp:400: Request processed in 36us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925210.806678:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788925210.806679:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892106880 00000100:00080000:3.0:1788925210.806703:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788925210.806710:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925210.806713:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925210.806822:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:3.0:1788925210.807311:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892106880:12345-192.168.203.4@tcp:400: 00000100:00100000:0.0:1788925210.807595:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892106752 00000100:00100000:0.0:1788925210.807603:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892106752 00000100:00100000:0.0:1788925210.807653:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 130 00000100:00100000:0.0:1788925210.807663:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892106752:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1788925210.807786:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892106880:12345-192.168.203.4@tcp:400: Request processed in 947us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925210.807795:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:0.0:1788925210.812925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892106752:12345-192.168.203.4@tcp:400: Request processed in 5244us (6932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925210.812946:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 130 00010000:00010000:2.0:1788925211.713994:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925212.736928:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788925212.736945:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925212.736958:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911003136:0@lo:13: 00000100:00100000:1.0:1788925212.737032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925212.737057:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911003136 00000100:00100000:3.0:1788925212.737067:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911003136 00000100:00100000:3.0:1788925212.737144:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925212.737154:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911003136:12345-0@lo:13: 00002000:00000024:3.0:1788925212.737186:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925212.737243:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911003136:12345-0@lo:13: Request processed in 90us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925212.737251:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788925212.737288:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2e9dea00 x1875823911003136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925212.737307:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911003136:0@lo:13: 00000100:00080000:1.0:1788925212.737451:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788925213.761887:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925213.772025:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911003648:0@lo:400: 00000100:00100000:0.0:1788925213.772092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925213.772142:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788925213.772148:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911003264:0@lo:400: 00000100:00100000:0.0:1788925213.772176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925213.772196:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823911003776:0@lo:400: 00000100:00100000:0.0:1788925213.772226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925213.772249:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911003520:0@lo:400: 00000100:00100000:0.0:1788925213.772274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925213.772289:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788925213.772294:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911003392:0@lo:400: 00000100:00100000:0.0:1788925213.772314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925213.772333:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911003904:0@lo:400: 00000100:00100000:0.0:1788925213.772352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925213.772378:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911003776 00000100:00100000:0.0:1788925213.772384:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911003776 00000100:00100000:0.0:1788925213.772430:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911003520 00000100:00100000:0.0:1788925213.772434:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911003520 00000100:00100000:0.0:1788925213.772447:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911003392 00000100:00100000:0.0:1788925213.772450:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911003392 00000100:00100000:0.0:1788925213.772465:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788925213.772473:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823911003776:12345-0@lo:400: 00000100:00100000:0.0:1788925213.772522:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823911003776:12345-0@lo:400: Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925213.772537:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788925213.772554:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925213.772561:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911003520:12345-0@lo:400: 00000100:00100000:0.0:1788925213.772593:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911003520:12345-0@lo:400: Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925213.772599:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925213.772610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788925213.772616:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911003392:12345-0@lo:400: 00000100:00100000:0.0:1788925213.772641:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911003392:12345-0@lo:400: Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925213.772646:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788925213.772661:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925213.772688:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911003392:0@lo:400: 00000100:00100000:0.0:1788925213.772699:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911003520:0@lo:400: 00000100:00100000:0.0:1788925213.772728:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823911003776:0@lo:400: 00000100:00100000:3.0:1788925213.772943:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911003648 00000100:00100000:3.0:1788925213.772948:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911003648 00000100:00100000:3.0:1788925213.772974:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911003904 00000100:00100000:3.0:1788925213.772977:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911003904 00000100:00100000:3.0:1788925213.772997:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925213.773004:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911003648:12345-0@lo:400: 00000100:00100000:3.0:1788925213.773044:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911003648:12345-0@lo:400: Request processed in 40us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925213.773050:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925213.773061:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925213.773067:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911003904:12345-0@lo:400: 00000100:00100000:3.0:1788925213.773098:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911003904:12345-0@lo:400: Request processed in 31us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925213.773103:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925213.773119:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911003264 00000100:00100000:3.0:1788925213.773122:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911003264 00000100:00100000:3.0:1788925213.773146:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788925213.773152:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911003264:12345-0@lo:400: 00000100:00100000:3.0:1788925213.773181:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911003264:12345-0@lo:400: Request processed in 28us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925213.773187:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1788925213.773230:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788925213.773249:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2e7e1180 x1875823911003904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925213.773260:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911003904:0@lo:400: 00000100:00100000:3.0:1788925213.773283:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911003264:0@lo:400: 00010000:00080000:3.0:1788925213.773292:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2e7e1500 x1875823911003648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925213.773300:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911003648:0@lo:400: 00000100:00100000:3.0:1788925214.273226:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911004032:0@lo:13: 00000100:00100000:3.0:1788925214.273291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925214.273419:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911004032 00000100:00100000:3.0:1788925214.273426:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911004032 00000100:00100000:3.0:1788925214.273484:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925214.273494:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911004032:12345-0@lo:13: 00002000:00000024:3.0:1788925214.273529:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925214.273583:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911004032:12345-0@lo:13: Request processed in 90us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925214.273591:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788925214.274122:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2ea90a80 x1875823911004032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925214.274141:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911004032:0@lo:13: 00000020:00000080:2.0:1788925214.685299:0:8441:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff442b7410 20000000:00000080:2.0:1788925214.685395:0:8441:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e0d41fcb800 uarg=0000000000000000 20000000:01000000:2.0:1788925214.685433:0:8441:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788925214.685436:0:8441:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788925214.685439:0:8441:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788925214.685443:0:8441:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788925214.685448:0:8441:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788925214.685461:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788925214.685464:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788925214.686244:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788925214.686256:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788925214.688218:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788925214.688674:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788925214.689003:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788925214.689056:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788925214.689070:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788925214.689072:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788925214.690370:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788925214.690811:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788925214.690873:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788925214.690929:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788925214.690947:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788925214.690950:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788925214.693545:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788925214.696019:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788925214.696096:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788925214.696147:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788925214.696166:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788925214.696168:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788925214.697781:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788925214.702401:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788925214.704384:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788925214.704485:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788925214.704509:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788925214.704527:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.704619:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29138b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.704628:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913b5 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.704635:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913df expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.704641:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913ed expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.704648:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913fb expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.704678:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291417 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.704684:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29143a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.704693:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd07 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.705099:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd0e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.705117:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.705158:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd0e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.705171:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd0e expref: 9 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.705185:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004160:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788925214.705292:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd07 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.705300:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd07 expref: 9 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.705643:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004288:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788925214.705712:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a29143a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.705721:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a29143a expref: 18 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.705730:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004416:0@lo:104: 00000100:00100000:2.0:1788925214.705810:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925214.705845:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a291417 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.705854:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a291417 expref: 18 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.705863:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004544:0@lo:104: 00000100:00100000:0.0:1788925214.705878:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911004416 00000100:00100000:2.0:1788925214.705885:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925214.705886:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911004416 00000100:00100000:0.0:1788925214.705927:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788925214.705936:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911004544 00000100:00100000:0.0:1788925214.705939:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911004544 00000100:00100000:0.0:1788925214.705954:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925214.705964:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+4:8441:x1875823911004416:12345-0@lo:104: 00010000:00010000:0.0:1788925214.705984:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706033:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925214.706039:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+4:8441:x1875823911004416:12345-0@lo:104: Request processed in 77us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.706046:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925214.706067:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788925214.706074:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e5d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911004544:12345-0@lo:104: 00010000:00010000:0.0:1788925214.706081:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706113:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788925214.706118:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e5d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911004544:12345-0@lo:104: Request processed in 46us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.706124:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788925214.706167:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788925214.706172:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706179:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00030e00 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925214.706183:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706193:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925214.706200:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925214.706212:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925214.706241:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706248:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925214.706267:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925214.706274:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911004672:0@lo:103: 00010000:00010000:0.0:1788925214.706274:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d00030e00/0xb29fc47e1a29143a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291441 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706286:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925214.706289:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706294:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9000 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925214.706297:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925214.706302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925214.706304:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925214.706310:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925214.706315:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925214.706327:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706332:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788925214.706346:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911004672 00010000:00010000:0.0:1788925214.706347:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925214.706349:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911004672 00010000:00010000:0.0:1788925214.706354:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9000/0xb29fc47e1a291417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29141e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706362:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925214.706364:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925214.706366:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29143a expref: 19 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706366:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925214.706372:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925214.706378:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925214.706384:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925214.706385:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911004800:0@lo:103: 00000100:00100000:1.0:1788925214.706390:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911004672:12345-0@lo:103: 00010000:00010000:1.0:1788925214.706399:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925214.706404:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29143a expref: 19 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.706407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925214.706414:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a29143a expref: 19 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.706428:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788925214.706429:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925214.706434:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788925214.706447:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788925214.706453:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911004672:12345-0@lo:103: Request processed in 63us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.706453:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911004800 00000100:00100000:0.0:1788925214.706456:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911004800 00000100:00100000:1.0:1788925214.706465:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788925214.706467:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291417 expref: 20 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.706575:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788925214.706582:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911004800:12345-0@lo:103: 00010000:00010000:0.0:1788925214.706589:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925214.706593:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291417 expref: 19 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706601:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a291417 expref: 19 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.706612:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925214.706642:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911004800:12345-0@lo:103: Request processed in 61us (233us total) trans 0 rc 0/0 00010000:00010000:2.0:1788925214.706645:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2913fb expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.706648:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788925214.706655:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2913fb expref: 19 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.706663:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004928:0@lo:104: 00000100:00100000:0.0:1788925214.706675:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911004800:0@lo:103: 00000100:00100000:0.0:1788925214.706684:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911004672:0@lo:103: 00000100:00100000:2.0:1788925214.706686:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925214.706704:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911004928 00000100:00100000:0.0:1788925214.706707:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911004928 00010000:00010000:2.0:1788925214.706720:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2913ed expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.706727:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788925214.706728:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2913ed expref: 18 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.706733:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911004928:12345-0@lo:104: 00010000:00010000:0.0:1788925214.706740:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.706776:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911005056:0@lo:104: 00000100:00100000:2.0:1788925214.706796:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925214.706803:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925214.706807:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911004928:12345-0@lo:104: Request processed in 75us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.706813:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925214.706823:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911005056 00000100:00100000:0.0:1788925214.706825:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911005056 00010000:00010000:2.0:1788925214.706839:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2913df expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.706839:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788925214.706848:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2913df expref: 18 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.706857:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911005184:0@lo:104: 00000100:00100000:2.0:1788925214.706877:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925214.706895:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2913b5 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.706960:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911005056:12345-0@lo:104: 00010000:00010000:0.0:1788925214.706969:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707004:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788925214.707009:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911005056:12345-0@lo:104: Request processed in 165us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.707015:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788925214.707032:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911005184 00000100:00100000:0.0:1788925214.707035:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911005184 00000100:00100000:0.0:1788925214.707049:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788925214.707054:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911005184:12345-0@lo:104: 00010000:00010000:0.0:1788925214.707061:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707089:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788925214.707093:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911005184:12345-0@lo:104: Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.707098:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788925214.707114:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788925214.707118:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707125:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00030c00 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925214.707128:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707135:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925214.707142:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925214.707147:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925214.707166:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707171:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925214.707190:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707197:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a2913fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291402 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707207:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788925214.707210:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707216:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148b000 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925214.707219:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707225:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925214.707231:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925214.707236:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925214.707249:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707255:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925214.707260:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707266:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d0148b000/0xb29fc47e1a2913ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913f4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707277:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925214.707287:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707292:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8dc00 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925214.707295:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707301:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925214.707306:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925214.707311:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925214.707323:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707328:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925214.707337:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707343:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8dc00/0xb29fc47e1a2913df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913e6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707351:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925214.707353:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925214.707355:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925214.707371:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911005568:0@lo:103: 00000100:00100000:0.0:1788925214.707395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925214.707413:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925214.707418:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911005440:0@lo:103: 00000100:00100000:0.0:1788925214.707447:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925214.707465:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911005568 00000100:00100000:0.0:1788925214.707469:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911005568 00010000:00010000:0.0:1788925214.707483:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913ed expref: 19 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.707495:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911005440 00000100:00100000:0.0:1788925214.707497:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911005440 00010000:00010000:0.0:1788925214.707507:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913fb expref: 20 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.707519:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925214.707524:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+20:3305:x1875823911005568:12345-0@lo:103: 00010000:00010000:2.0:1788925214.707525:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2913b5 expref: 20 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707532:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788925214.707534:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911005312:0@lo:104: 00010000:00010000:0.0:1788925214.707536:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913ed expref: 20 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707544:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2913ed expref: 20 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707555:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925214.707582:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+20:3305:x1875823911005568:12345-0@lo:103: Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.707588:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925214.707602:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788925214.707608:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911005440:12345-0@lo:103: 00010000:00010000:0.0:1788925214.707615:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925214.707620:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913fb expref: 19 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.707632:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925214.707639:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2913fb expref: 19 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.707649:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925214.707656:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a29138b expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925214.707665:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a29138b expref: 19 pid: 5831 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.707669:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911005440:12345-0@lo:103: Request processed in 62us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925214.707673:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911005824:0@lo:104: 00000100:00100000:0.0:1788925214.707675:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788925214.707692:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925214.707701:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911005440:0@lo:103: 00000100:00100000:0.0:1788925214.707709:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911005568:0@lo:103: 00000100:00100000:2.0:1788925214.707797:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1805d300 going to sleep for 11 seconds 00010000:00010000:2.0:1788925214.707811:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07ed8400/0xb29fc47e1a291441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a29143a expref: 18 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.707827:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004416:0@lo:104: 00000100:00100000:0.0:1788925214.707832:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911005312 00000100:00100000:0.0:1788925214.707836:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911005312 00010000:00010000:2.0:1788925214.707838:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d00030600/0xb29fc47e1a29141e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a291417 expref: 17 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.707846:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004544:0@lo:104: 00010000:00010000:2.0:1788925214.707855:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07ed8600/0xb29fc47e1a291402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2913fb expref: 16 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.707862:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004928:0@lo:104: 00010000:00010000:2.0:1788925214.707870:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07ed8e00/0xb29fc47e1a2913f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2913ed expref: 15 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925214.707876:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911005056:0@lo:104: 00000100:00100000:2.0:1788925214.707883:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9de300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911005184:0@lo:104: 00000100:00100000:0.0:1788925214.707933:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911005824 00000100:00100000:0.0:1788925214.707936:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911005824 00000100:00100000:0.0:1788925214.707949:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788925214.707955:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+4:8441:x1875823911005312:12345-0@lo:104: 00010000:00010000:0.0:1788925214.707963:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708013:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925214.708019:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+4:8441:x1875823911005312:12345-0@lo:104: Request processed in 64us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.708024:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788925214.708037:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788925214.708043:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911005824:12345-0@lo:104: 00010000:00010000:0.0:1788925214.708050:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708088:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788925214.708092:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+3:8441:x1875823911005824:12345-0@lo:104: Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.708099:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788925214.708119:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911005696:0@lo:103: 00000100:00100000:0.0:1788925214.708140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925214.708163:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788925214.708168:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708175:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9400 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925214.708177:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708184:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925214.708190:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925214.708195:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925214.708214:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708220:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925214.708228:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708234:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9400/0xb29fc47e1a2913b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913bc expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708251:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925214.708254:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708259:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed8a00 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925214.708261:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708267:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925214.708273:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925214.708278:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925214.708292:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708297:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925214.708306:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708312:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8a00/0xb29fc47e1a29138b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291392 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708325:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925214.708327:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925214.708329:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925214.708339:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925214.708353:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911006080:0@lo:103: 00000100:00100000:0.0:1788925214.708383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925214.708411:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925214.708417:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911005952:0@lo:103: 00000100:00100000:0.0:1788925214.708439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925214.708452:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925214.708459:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911005696 00000100:00100000:0.0:1788925214.708462:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911005696 00010000:00010000:0.0:1788925214.708476:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913df expref: 15 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.708487:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911006080 00000100:00100000:0.0:1788925214.708489:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911006080 00010000:00010000:0.0:1788925214.708498:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29138b expref: 16 pid: 5831 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.708507:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911005952 00000100:00100000:0.0:1788925214.708509:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911005952 00010000:00010000:0.0:1788925214.708518:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913b5 expref: 17 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.708530:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788925214.708536:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+17:3306:x1875823911005696:12345-0@lo:103: 00010000:00010000:0.0:1788925214.708544:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925214.708548:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913df expref: 17 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708556:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2913df expref: 17 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708566:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d0148a200/0xb29fc47e1a2913e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2913df expref: 17 pid: 5833 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708582:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925214.708609:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+16:3306:x1875823911005696:12345-0@lo:103: Request processed in 74us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.708616:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788925214.708629:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788925214.708634:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+15:3305:x1875823911006080:12345-0@lo:103: 00010000:00010000:0.0:1788925214.708642:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925214.708646:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29138b expref: 15 pid: 5831 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708654:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a29138b expref: 15 pid: 5831 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708663:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925214.708688:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+15:3305:x1875823911006080:12345-0@lo:103: Request processed in 54us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.708693:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788925214.708705:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788925214.708711:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d085fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+14:3306:x1875823911005952:12345-0@lo:103: 00010000:00010000:0.0:1788925214.708717:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925214.708721:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913b5 expref: 14 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708728:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2913b5 expref: 14 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925214.708737:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925214.708795:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d085fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+14:3306:x1875823911005952:12345-0@lo:103: Request processed in 84us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925214.708801:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788925214.709145:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2913bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2913b5 expref: 13 pid: 5832 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925214.709155:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911005312:0@lo:104: 00010000:00010000:1.0:1788925214.709165:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d00031e00/0xb29fc47e1a291392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a29138b expref: 12 pid: 5831 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925214.709172:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911005824:0@lo:104: 00000100:00100000:0.0:1788925214.709271:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911006080:0@lo:103: 00000100:00100000:0.0:1788925214.709297:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911005952:0@lo:103: 00000100:00100000:0.0:1788925214.709304:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911005696:0@lo:103: 00000100:00100000:1.0:1788925214.710017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925214.710057:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892107264 00000100:00100000:3.0:1788925214.710064:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892107264 00010000:00010000:3.0:1788925214.710089:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd0e expref: 10 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925214.710125:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788925214.710133:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892107264:12345-192.168.203.4@tcp:103: 00000100:00100000:2.0:1788925214.710147:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004160:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788925214.710152:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925214.710157:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd0e expref: 10 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.710168:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd0e expref: 10 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.710181:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d0148a800/0xb29fc47e1a29145d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd0e expref: 10 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.710193:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925214.710251:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:2383:x1875823892107264:12345-192.168.203.4@tcp:103: Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925214.710257:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:1.0:1788925214.730693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925214.730726:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875823911004288:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788925214.730891:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925214.731006:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892107392 00000100:00100000:0.0:1788925214.731014:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892107392 00010000:00010000:3.0:1788925214.731278:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd07 expref: 9 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925214.731317:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:3.0:1788925214.731327:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:2382:x1875823892107392:12345-192.168.203.4@tcp:103: 00010000:00010000:3.0:1788925214.731340:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925214.731345:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd07 expref: 9 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731562:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd07 expref: 9 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731579:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a291456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd07 expref: 9 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731614:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731622:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731637:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731644:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731651:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731657:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731663:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9a00 already unused, calling callback (ffffffffc141f230) 00010000:00010000:3.0:1788925214.731668:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731675:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731684:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731694:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925214.731811:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:2382:x1875823892107392:12345-192.168.203.4@tcp:103: Request processed in 484us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925214.731825:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00010000:00010000:3.0:1788925214.731853:0:8441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731861:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.731868:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07ed9a00/0xb29fc47e1a291495 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925214.787236:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925215.809104:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925215.913088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925215.913131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925215.913156:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925215.913193:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925215.913231:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892107520 00000100:00100000:0.0:1788925215.913240:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892107520 00000100:00100000:0.0:1788925215.913285:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:0.0:1788925215.913294:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:2384:x1875823892107520:12345-192.168.203.4@tcp:400: 00000100:00100000:2.0:1788925215.913331:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892107648 00000100:00100000:2.0:1788925215.913338:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892107648 00000100:00100000:0.0:1788925215.913376:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:2384:x1875823892107520:12345-192.168.203.4@tcp:400: Request processed in 81us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925215.913384:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 132 00000100:00100000:2.0:1788925215.913394:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1788925215.913404:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892107648:12345-192.168.203.4@tcp:400: 00000100:00100000:2.0:1788925215.913443:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892107648:12345-192.168.203.4@tcp:400: Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925215.913466:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:3.0:1788925215.913532:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892107776 00000100:00100000:3.0:1788925215.913537:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892107776 00000100:00100000:3.0:1788925215.913571:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892107904 00000100:00100000:3.0:1788925215.913574:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892107904 00000100:00100000:3.0:1788925215.913591:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788925215.913599:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892107776:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1788925215.913627:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892107776:12345-192.168.203.4@tcp:400: Request processed in 28us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925215.913634:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:3.0:1788925215.913646:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1788925215.913651:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892107904:12345-192.168.203.4@tcp:400: 00000100:00100000:3.0:1788925215.913671:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892107904:12345-192.168.203.4@tcp:400: Request processed in 21us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925215.913677:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00080000:3.0:1788925215.913695:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925215.913699:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925215.913708:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1788925216.000934:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788925216.000942:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e0d0b757000 from 39 10000000:01000000:2.0:1788925216.000948:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788925216.000998:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8600/0xb29fc47e1a29149c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.001008:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8600/0xb29fc47e1a29149c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.001020:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8600/0xb29fc47e1a29149c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925216.001040:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006208:0@lo:101: 00000100:00100000:2.0:1788925216.001110:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925216.001163:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1805d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788925216.001243:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911006208 00000100:00100000:3.0:1788925216.001251:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911006208 00000100:00100000:3.0:1788925216.001305:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788925216.001315:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+12:5836:x1875823911006208:12345-0@lo:101: 00010000:00010000:3.0:1788925216.001329:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925216.001342:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2914a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29149c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.001363:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2914a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29149c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.001373:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8de00/0xb29fc47e1a2914a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29149c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.001381:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8de00, rc 0) 00000100:00100000:3.0:1788925216.001426:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823911006208:12345-0@lo:101: Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925216.001433:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788925216.001514:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006208:0@lo:101: 00010000:00010000:2.0:1788925216.001529:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8600/0xb29fc47e1a29149c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.001538:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8600/0xb29fc47e1a29149c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2914a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925216.001596:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006336:0@lo:501: 00000100:00100000:2.0:1788925216.001620:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925216.001642:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1805d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.001770:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911006336 00000100:00100000:0.0:1788925216.001775:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911006336 00000100:00100000:0.0:1788925216.001808:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788925216.001816:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823911006336:12345-0@lo:501: 00000100:00100000:0.0:1788925216.002066:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823911006336:12345-0@lo:501: Request processed in 250us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.002083:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788925216.002172:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006336:0@lo:501: 00000100:00100000:1.0:1788925216.002200:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006464:0@lo:503: 00000100:00100000:1.0:1788925216.002239:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.002266:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449240 going to sleep for 11 seconds 00000100:00100000:2.0:1788925216.002317:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911006464 00000100:00100000:2.0:1788925216.002321:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911006464 00000100:00100000:2.0:1788925216.002345:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788925216.002352:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823911006464:12345-0@lo:503: 00000100:00100000:2.0:1788925216.002500:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823911006464:12345-0@lo:503: Request processed in 148us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925216.002507:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788925216.002587:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006464:0@lo:503: 00000100:00100000:1.0:1788925216.003098:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8460:1875823911006592:0@lo:502: 00000100:00100000:1.0:1788925216.003137:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.003170:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.003329:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911006592 00000100:00100000:0.0:1788925216.003334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911006592 00000100:00100000:0.0:1788925216.003367:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788925216.003375:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:8460:x1875823911006592:12345-0@lo:502: 00000100:00100000:0.0:1788925216.003574:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:8460:x1875823911006592:12345-0@lo:502: Request processed in 198us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.003580:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788925216.003684:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8460:1875823911006592:0@lo:502: 00000100:00100000:1.0:1788925216.003722:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8460:1875823911006720:0@lo:502: 00000100:00100000:1.0:1788925216.003788:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.003811:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.003968:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911006720 00000100:00100000:0.0:1788925216.003972:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911006720 00000100:00100000:0.0:1788925216.003991:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788925216.003997:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:8460:x1875823911006720:12345-0@lo:502: 00000100:00100000:0.0:1788925216.004125:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:8460:x1875823911006720:12345-0@lo:502: Request processed in 127us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.004131:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788925216.004394:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8460:1875823911006720:0@lo:502: 00000040:00080000:1.0:1788925216.004423:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788925216.004582:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788925216.004605:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788925216.004615:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8600/0xb29fc47e1a29149c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.004626:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8600/0xb29fc47e1a29149c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914a3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925216.004635:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788925216.004638:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788925216.004640:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788925216.004835:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8400/0xb29fc47e1a2914aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.004844:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8400/0xb29fc47e1a2914aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.004853:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8400/0xb29fc47e1a2914aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925216.004868:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006848:0@lo:101: 00000100:00100000:2.0:1788925216.004899:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925216.004929:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1805d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.005030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911006848 00000100:00100000:0.0:1788925216.005035:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911006848 00000100:00100000:0.0:1788925216.005104:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788925216.005110:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+13:5836:x1875823911006848:12345-0@lo:101: 00010000:00010000:0.0:1788925216.005119:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925216.005130:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d00030e00/0xb29fc47e1a2914b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2914aa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.005149:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d00030e00/0xb29fc47e1a2914b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2914aa expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.005159:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d00030e00/0xb29fc47e1a2914b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2914aa expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.005176:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00030e00, rc 0) 00000100:00100000:0.0:1788925216.005217:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823911006848:12345-0@lo:101: Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.005223:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788925216.005295:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006848:0@lo:101: 00010000:00010000:1.0:1788925216.005308:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8400/0xb29fc47e1a2914aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.005316:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8400/0xb29fc47e1a2914aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2914b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925216.005366:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006976:0@lo:501: 00000100:00100000:1.0:1788925216.005388:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.018034:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925216.024451:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911006976 00000100:00100000:2.0:1788925216.024465:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911006976 00000100:00100000:2.0:1788925216.024531:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788925216.024541:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823911006976:12345-0@lo:501: 00000100:00100000:2.0:1788925216.027142:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823911006976:12345-0@lo:501: Request processed in 2594us (21743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925216.027156:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788925216.027304:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911006976:0@lo:501: 00000100:00100000:1.0:1788925216.027345:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911007104:0@lo:503: 00000100:00100000:1.0:1788925216.027385:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.027410:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.027919:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911007104 00000100:00100000:0.0:1788925216.027926:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911007104 00000100:00100000:0.0:1788925216.027976:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788925216.027985:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823911007104:12345-0@lo:503: 00000100:00100000:0.0:1788925216.028222:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823911007104:12345-0@lo:503: Request processed in 237us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.028229:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788925216.028404:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911007104:0@lo:503: 00000100:00100000:1.0:1788925216.028914:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8461:1875823911007232:0@lo:502: 00000100:00100000:1.0:1788925216.028962:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.029000:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449240 going to sleep for 11 seconds 00000100:00100000:3.0:1788925216.029115:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911007232 00000100:00100000:3.0:1788925216.029120:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911007232 00000100:00100000:3.0:1788925216.029156:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788925216.029164:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:8461:x1875823911007232:12345-0@lo:502: 00000100:00100000:3.0:1788925216.029334:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+14:8461:x1875823911007232:12345-0@lo:502: Request processed in 170us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925216.029341:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788925216.029450:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8461:1875823911007232:0@lo:502: 00000020:01000000:1.0:1788925216.029472:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925216.029481:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925216.029483:0:8461:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788925216.029490:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788925216.029509:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8461:1875823911007360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925216.029547:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.030225:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.032643:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911007360 00000100:00100000:0.0:1788925216.032909:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911007360 00000100:00100000:1.0:1788925216.035889:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788925216.035904:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:8461:x1875823911007360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925216.036177:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+14:8461:x1875823911007360:12345-0@lo:502:llog_process_th.0 Request processed in 275us (6628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925216.036184:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788925216.036739:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8461:1875823911007360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788925216.036807:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925216.036814:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925216.036817:0:8461:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788925216.036821:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788925216.037991:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788925216.038015:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788925216.038025:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8400/0xb29fc47e1a2914aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.038036:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed8400/0xb29fc47e1a2914aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914b1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925216.038045:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788925216.038048:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e0d04b8b800 from 39 10000000:01000000:1.0:1788925216.038050:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788925216.038086:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148bc00/0xb29fc47e1a2914b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.038093:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d0148bc00/0xb29fc47e1a2914b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.038102:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d0148bc00/0xb29fc47e1a2914b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925216.038122:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911007488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.038185:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.038224:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925216.038265:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911007488 00000100:00100000:2.0:1788925216.038273:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911007488 00000100:00100000:2.0:1788925216.038315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788925216.038323:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+14:5836:x1875823911007488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925216.038335:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925216.038345:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed8200/0xb29fc47e1a2914bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2914b8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.038365:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed8200/0xb29fc47e1a2914bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2914b8 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.038374:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07ed8200/0xb29fc47e1a2914bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2914b8 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.038382:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed8200, rc 0) 00000100:00100000:2.0:1788925216.038431:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823911007488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925216.038438:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788925216.038520:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911007488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925216.038533:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d0148bc00/0xb29fc47e1a2914b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.038547:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148bc00/0xb29fc47e1a2914b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2914bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925216.038604:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911007616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925216.038629:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925216.038652:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e082d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925216.038932:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911007616 00000100:00100000:2.0:1788925216.038937:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911007616 00000100:00100000:2.0:1788925216.038968:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788925216.038975:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823911007616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925216.039204:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823911007616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925216.039212:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788925216.039282:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911007616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925216.039314:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911007744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925216.039352:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925216.039384:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e085b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788925216.039447:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911007744 00000100:00100000:1.0:1788925216.039452:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911007744 00000100:00100000:1.0:1788925216.039473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788925216.039479:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823911007744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.039820:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823911007744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 331us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925216.039827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788925216.044122:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911007744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.046868:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8462:1875823911007872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925216.046940:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.046977:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.047106:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911007872 00000100:00100000:0.0:1788925216.047113:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911007872 00000100:00100000:0.0:1788925216.047157:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788925216.047166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:8462:x1875823911007872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925216.047402:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+15:8462:x1875823911007872:12345-0@lo:502:llog_process_th.0 Request processed in 236us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.047422:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788925216.047562:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8462:1875823911007872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925216.047606:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8462:1875823911008000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925216.047639:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.047699:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925216.050502:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911008000 00000100:00100000:2.0:1788925216.050517:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911008000 00000100:00100000:2.0:1788925216.050568:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788925216.050578:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:8462:x1875823911008000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925216.050908:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+15:8462:x1875823911008000:12345-0@lo:502:llog_process_th.0 Request processed in 331us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925216.050916:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788925216.051130:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8462:1875823911008000:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788925216.051164:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788925216.051476:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788925216.051493:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788925216.051502:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148bc00/0xb29fc47e1a2914b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.051514:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d0148bc00/0xb29fc47e1a2914b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914bf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925216.051523:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788925216.051526:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788925216.051528:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788925216.051553:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9e00/0xb29fc47e1a2914c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.051561:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9e00/0xb29fc47e1a2914c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.051576:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9e00/0xb29fc47e1a2914c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925216.051593:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788925216.051627:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925216.051713:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1805d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788925216.051777:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911008128 00000100:00100000:3.0:1788925216.051782:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911008128 00000100:00100000:3.0:1788925216.051808:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788925216.051816:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+15:5836:x1875823911008128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925216.051825:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925216.051836:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8c000/0xb29fc47e1a2914cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2914c6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.051856:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8c000/0xb29fc47e1a2914cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2914c6 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.051867:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8c000/0xb29fc47e1a2914cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2914c6 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.051876:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8c000, rc 0) 00000100:00100000:3.0:1788925216.051913:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823911008128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925216.051918:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788925216.051990:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925216.052002:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9e00/0xb29fc47e1a2914c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.052011:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9e00/0xb29fc47e1a2914c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2914cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925216.052055:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.052080:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.052112:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.052173:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911008256 00000100:00100000:0.0:1788925216.052178:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911008256 00000100:00100000:0.0:1788925216.052212:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788925216.052218:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823911008256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925216.052441:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823911008256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.052448:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788925216.052623:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.052649:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.052698:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.052716:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.052833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911008384 00000100:00100000:0.0:1788925216.052838:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911008384 00000100:00100000:0.0:1788925216.052857:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788925216.052863:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823911008384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925216.053009:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823911008384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.053016:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788925216.053382:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.054002:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8463:1875823911008512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925216.054047:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.054071:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d114490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.054123:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911008512 00000100:00100000:0.0:1788925216.054128:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911008512 00000100:00100000:0.0:1788925216.054166:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788925216.054173:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:8463:x1875823911008512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925216.054348:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:8463:x1875823911008512:12345-0@lo:502:llog_process_th.0 Request processed in 175us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.054355:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788925216.054513:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8463:1875823911008512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788925216.054538:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925216.054546:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925216.054548:0:8463:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788925216.054554:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788925216.054572:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8463:1875823911008640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925216.054601:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.054624:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d114490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925216.054675:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911008640 00000100:00100000:3.0:1788925216.054679:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911008640 00000100:00100000:3.0:1788925216.054714:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788925216.054721:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:8463:x1875823911008640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925216.054865:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+16:8463:x1875823911008640:12345-0@lo:502:llog_process_th.0 Request processed in 144us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925216.054871:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788925216.055188:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8463:1875823911008640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788925216.055216:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925216.055221:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925216.055223:0:8463:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788925216.055227:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788925216.055468:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788925216.055484:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788925216.055493:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9e00/0xb29fc47e1a2914c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.055503:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9e00/0xb29fc47e1a2914c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925216.055512:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788925216.055515:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e0d1882f800 from 39 10000000:01000000:3.0:1788925216.055518:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788925216.055541:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c200/0xb29fc47e1a2914d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.055549:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c200/0xb29fc47e1a2914d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.055557:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c200/0xb29fc47e1a2914d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925216.055571:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788925216.055600:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925216.055633:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e082540 going to sleep for 11 seconds 00000100:00100000:2.0:1788925216.055704:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911008768 00000100:00100000:2.0:1788925216.055709:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911008768 00000100:00100000:2.0:1788925216.055767:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788925216.055775:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823911008768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925216.055784:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925216.055795:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed8c00/0xb29fc47e1a2914db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2914d4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.055814:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed8c00/0xb29fc47e1a2914db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2914d4 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.055823:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07ed8c00/0xb29fc47e1a2914db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2914d4 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925216.055831:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed8c00, rc 0) 00000100:00100000:2.0:1788925216.055861:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911008768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925216.055867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788925216.055993:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925216.056006:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c200/0xb29fc47e1a2914d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.056014:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c200/0xb29fc47e1a2914d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2914db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925216.056055:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925216.056078:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925216.056107:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e082540 going to sleep for 11 seconds 00000100:00100000:1.0:1788925216.056178:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911008896 00000100:00100000:1.0:1788925216.056182:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911008896 00000100:00100000:1.0:1788925216.056216:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788925216.056224:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911008896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.056442:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911008896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925216.056449:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788925216.056626:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911008896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925216.056653:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911009024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925216.056699:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925216.056721:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e082540 going to sleep for 11 seconds 00000100:00100000:2.0:1788925216.057188:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911009024 00000100:00100000:2.0:1788925216.057202:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911009024 00000100:00100000:2.0:1788925216.057233:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788925216.057239:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911009024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925216.057379:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911009024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925216.057386:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788925216.057907:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911009024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925216.058595:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8464:1875823911009152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925216.058651:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925216.058805:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e085e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925216.060337:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911009152 00000100:00100000:3.0:1788925216.060348:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911009152 00000100:00100000:3.0:1788925216.060408:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788925216.060418:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:8464:x1875823911009152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925216.060970:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:8464:x1875823911009152:12345-0@lo:502:llog_process_th.0 Request processed in 551us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925216.060979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788925216.061159:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8464:1875823911009152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925216.061230:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8464:1875823911009280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925216.061276:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925216.061313:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e085e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788925216.061422:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911009280 00000100:00100000:1.0:1788925216.061427:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911009280 00000100:00100000:1.0:1788925216.061465:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788925216.061473:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:8464:x1875823911009280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925216.061673:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:8464:x1875823911009280:12345-0@lo:502:llog_process_th.0 Request processed in 201us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925216.061680:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788925216.062219:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8464:1875823911009280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788925216.062247:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788925216.062422:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788925216.062443:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788925216.062453:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c200/0xb29fc47e1a2914d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.062477:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8c200/0xb29fc47e1a2914d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914db expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925216.062485:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788925216.062488:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788925216.062490:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788925216.062516:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d000/0xb29fc47e1a2914e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.062523:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d000/0xb29fc47e1a2914e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.062532:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d000/0xb29fc47e1a2914e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925216.062558:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911009408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788925216.062598:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925216.062634:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e0826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925216.062887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911009408 00000100:00100000:1.0:1788925216.062893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911009408 00000100:00100000:1.0:1788925216.062928:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788925216.062937:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911009408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925216.062948:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925216.062960:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2914e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2914e2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.062980:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2914e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2914e2 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.062990:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d0148b800/0xb29fc47e1a2914e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2914e2 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.062998:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148b800, rc 0) 00000100:00100000:1.0:1788925216.063033:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911009408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925216.063049:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788925216.063128:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911009408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925216.063142:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d000/0xb29fc47e1a2914e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.063150:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d000/0xb29fc47e1a2914e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2914e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925216.063192:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911009536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925216.063221:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925216.063250:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e085e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925216.063291:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911009536 00000100:00100000:2.0:1788925216.063296:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911009536 00000100:00100000:2.0:1788925216.063326:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788925216.063333:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911009536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925216.063613:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911009536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925216.063620:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788925216.063941:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911009536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925216.063972:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911009664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925216.064008:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925216.064026:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e085e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925216.064082:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911009664 00000100:00100000:2.0:1788925216.064086:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911009664 00000100:00100000:2.0:1788925216.064106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788925216.064112:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911009664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925216.064296:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911009664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925216.064302:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788925216.064484:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911009664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925216.065242:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8465:1875823911009792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925216.065289:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925216.065333:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1805d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.065389:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911009792 00000100:00100000:0.0:1788925216.065399:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911009792 00000100:00100000:0.0:1788925216.065452:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788925216.065460:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:8465:x1875823911009792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925216.066280:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:8465:x1875823911009792:12345-0@lo:502:llog_process_th.0 Request processed in 819us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.066289:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788925216.067305:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8465:1875823911009792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788925216.067343:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925216.067353:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925216.067356:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788925216.067361:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788925216.067392:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8465:1875823911009920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925216.067504:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925216.067580:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e0826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925216.071465:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911009920 00000100:00100000:1.0:1788925216.071479:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911009920 00000100:00100000:1.0:1788925216.071569:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788925216.071580:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:8465:x1875823911009920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925216.072194:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:8465:x1875823911009920:12345-0@lo:502:llog_process_th.0 Request processed in 615us (4688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925216.072202:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788925216.072955:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8465:1875823911009920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788925216.073125:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925216.073133:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925216.073136:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788925216.073140:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788925216.073302:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788925216.073327:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788925216.073337:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d000/0xb29fc47e1a2914e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.073349:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d000/0xb29fc47e1a2914e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925216.073359:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788925216.073361:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e0d06a20000 from 1 10000000:01000000:0.0:1788925216.073364:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788925216.073394:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2914f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.073471:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2914f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.073483:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2914f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925216.073505:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911010048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.073988:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.074053:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e085480 going to sleep for 11 seconds 00000100:00100000:0.0:1788925216.074083:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911010048 00000100:00100000:0.0:1788925216.074090:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911010048 00000100:00100000:0.0:1788925216.074157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788925216.074167:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911010048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925216.074180:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925216.074192:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d00030200/0xb29fc47e1a2914f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a2914f0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.074214:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d00030200/0xb29fc47e1a2914f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a2914f0 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.074224:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d00030200/0xb29fc47e1a2914f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2914f0 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925216.074233:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00030200, rc 0) 00000100:00100000:0.0:1788925216.074274:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911010048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925216.074281:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788925216.074343:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e7e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911010048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925216.074357:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2914f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.074365:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2914f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a2914f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925216.074432:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911010176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925216.074456:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925216.074941:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d11449cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925216.075017:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911010176 00000100:00100000:3.0:1788925216.075023:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911010176 00000100:00100000:3.0:1788925216.075058:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788925216.075064:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911010176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925216.075287:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911010176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (829us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925216.075294:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788925216.075360:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911010176:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788925216.075382:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788925216.075389:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2914f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925216.075398:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d00030000/0xb29fc47e1a2914f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a2914f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925216.833213:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925217.857253:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925217.860586:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925217.860608:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911010304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925217.860676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925217.860815:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911010304 00000100:00100000:2.0:1788925217.860823:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911010304 00000100:00100000:2.0:1788925217.860880:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788925217.860903:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911010304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925217.860937:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925217.860982:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911010304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925217.860988:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788925217.861402:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788925217.861435:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2e9de300 x1875823911010304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925217.861453:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911010304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925218.881281:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911010816:0@lo:400:kworker.0 00000100:00100000:3.0:1788925218.881358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925218.881411:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925218.881418:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911010688:0@lo:400:kworker.0 00000100:00100000:3.0:1788925218.881443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925218.881472:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911010816 00000100:00100000:3.0:1788925218.881479:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911010816 00000100:00100000:3.0:1788925218.881521:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925218.881529:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911010816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925218.881577:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911010816:12345-0@lo:400:kworker.0 Request processed in 48us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.881584:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925218.881606:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911010688 00000100:00100000:3.0:1788925218.881621:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911010688 00000100:00100000:3.0:1788925218.881674:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788925218.881681:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911010688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925218.881713:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911010688:12345-0@lo:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.881720:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788925218.881955:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925218.882130:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911010688:0@lo:400:kworker.0 00010000:00080000:3.0:1788925218.882147:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2ea91f80 x1875823911010816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925218.882156:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911010816:0@lo:400:kworker.0 00000100:00100000:0.0:1788925218.882360:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911010432:0@lo:400:kworker.0 00000100:00100000:0.0:1788925218.882400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.882435:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823911010944:0@lo:400:kworker.0 00000100:00100000:0.0:1788925218.882459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.882480:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788925218.882486:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823911010560:0@lo:400:kworker.0 00000100:00100000:0.0:1788925218.882508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.882526:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911011072:0@lo:400:kworker.0 00000100:00100000:0.0:1788925218.882559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925218.882586:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911010944 00000100:00100000:0.0:1788925218.882590:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911010944 00000100:00100000:3.0:1788925218.882737:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911010432 00000100:00100000:3.0:1788925218.882824:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911010432 00000100:00100000:3.0:1788925218.882857:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788925218.882863:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911010432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925218.882905:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911010432:12345-0@lo:400:kworker.0 Request processed in 42us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.882912:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788925218.882943:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911010432:0@lo:400:kworker.0 00000100:00100000:3.0:1788925218.882989:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911010560 00000100:00100000:3.0:1788925218.882992:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911010560 00000100:00100000:3.0:1788925218.883015:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788925218.883021:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823911010560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925218.883407:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788925218.883413:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823911010944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925218.883451:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875823911010944:12345-0@lo:400:kworker.0 Request processed in 37us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925218.883457:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788925218.883473:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788925218.883580:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925218.883670:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911011072 00000100:00100000:1.0:1788925218.883675:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911011072 00000100:00100000:1.0:1788925218.883720:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788925218.883737:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911011072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925218.883789:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911011072:12345-0@lo:400:kworker.0 Request processed in 62us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925218.883795:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788925218.883852:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925218.884243:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875823911010560:12345-0@lo:400:kworker.0 Request processed in 1221us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925218.884263:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788925218.891138:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875823911010560:0@lo:400:kworker.0 00010000:00080000:0.0:1788925218.891164:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2ea90e00 x1875823911011072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925218.891176:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911011072:0@lo:400:kworker.0 00000100:00100000:0.0:1788925218.891188:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875823911010944:0@lo:400:kworker.0 00000100:00100000:2.0:1788925219.393249:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911011200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925219.393326:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925219.393496:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911011200 00000100:00100000:3.0:1788925219.393504:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911011200 00000100:00100000:3.0:1788925219.393554:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925219.393563:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911011200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925219.393596:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925219.393652:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911011200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925219.393658:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788925219.393789:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1500 x1875823911011200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925219.393807:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911011200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925219.494257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925219.495297:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892108032 00000100:00100000:2.0:1788925219.495308:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892108032 00000100:00100000:2.0:1788925219.495372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:2.0:1788925219.495382:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+8:5624:x1875823892108032:12345-192.168.203.4@tcp:101: 00010000:00010000:2.0:1788925219.495398:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925219.495415:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed9c00/0xb29fc47e1a2914fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd70 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925219.495443:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed9c00/0xb29fc47e1a2914fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd70 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925219.495454:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07ed9c00/0xb29fc47e1a2914fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd70 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925219.495464:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed9c00, rc 0) 00000100:00100000:2.0:1788925219.495529:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5624:x1875823892108032:12345-192.168.203.4@tcp:101: Request processed in 148us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925219.495536:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 166 00000100:00100000:1.0:1788925219.500058:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925219.500148:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892108160 00000100:00100000:2.0:1788925219.500168:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892108160 00000100:00100000:2.0:1788925219.500222:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:2.0:1788925219.500231:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5624:x1875823892108160:12345-192.168.203.4@tcp:501: 00000100:00100000:2.0:1788925219.500509:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5624:x1875823892108160:12345-192.168.203.4@tcp:501: Request processed in 278us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925219.500517:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 167 00000100:00100000:0.0:1788925219.505404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925219.505768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892108288 00000100:00100000:2.0:1788925219.505778:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892108288 00000100:00100000:2.0:1788925219.505833:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:2.0:1788925219.505843:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5624:x1875823892108288:12345-192.168.203.4@tcp:503: 00000100:00100000:2.0:1788925219.506107:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5624:x1875823892108288:12345-192.168.203.4@tcp:503: Request processed in 264us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925219.506116:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 168 00000100:00100000:0.0:1788925219.510322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925219.510893:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892108416 00000100:00100000:3.0:1788925219.510904:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892108416 00000100:00100000:3.0:1788925219.510957:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:3.0:1788925219.510967:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:6113:x1875823892108416:12345-192.168.203.4@tcp:502: 00000100:00100000:3.0:1788925219.511236:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:6113:x1875823892108416:12345-192.168.203.4@tcp:502: Request processed in 269us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925219.511244:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 169 00000100:00100000:1.0:1788925219.514549:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925219.514632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892108544 00000100:00100000:0.0:1788925219.514641:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892108544 00000100:00100000:0.0:1788925219.514691:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:0.0:1788925219.514702:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:6113:x1875823892108544:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788925219.515076:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:6113:x1875823892108544:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 374us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925219.515084:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 170 00000100:00100000:0.0:1788925219.526496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925219.527453:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892108672 00000100:00100000:2.0:1788925219.527465:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892108672 00000100:00100000:2.0:1788925219.527569:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:2.0:1788925219.527581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5624:x1875823892108672:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925219.527596:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925219.527610:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a291505 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd77 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925219.527637:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a291505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd77 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925219.527647:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07ed9800/0xb29fc47e1a291505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd77 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925219.527671:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed9800, rc 0) 00000100:00100000:2.0:1788925219.527740:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892108672:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925219.527761:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 171 00000100:00100000:1.0:1788925219.532942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925219.533084:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892108800 00000100:00100000:0.0:1788925219.533094:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892108800 00000100:00100000:0.0:1788925219.533153:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 172 00000100:00100000:0.0:1788925219.533163:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892108800:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925219.533464:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892108800:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 301us (529us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925219.533472:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 172 00010000:00010000:0.0:1788925219.905097:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925220.929497:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925221.030157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925221.030198:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925221.030230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925221.030254:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925221.030278:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892109312 00000100:00100000:3.0:1788925221.030286:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892109312 00000100:00100000:3.0:1788925221.030332:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892109184 00000100:00100000:3.0:1788925221.030335:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892109184 00000100:00100000:3.0:1788925221.030355:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1788925221.030364:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2384:x1875823892109312:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925221.030439:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2384:x1875823892109312:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.030447:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:3.0:1788925221.030463:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788925221.030470:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2384:x1875823892109184:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925221.030492:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2384:x1875823892109184:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 23us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.030498:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:3.0:1788925221.030515:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892108928 00000100:00100000:3.0:1788925221.030518:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892108928 00000100:00100000:3.0:1788925221.030549:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00100000:3.0:1788925221.030568:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892108928:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925221.030593:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892108928:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.030599:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 173 00000100:00080000:3.0:1788925221.030626:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925221.030629:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788925221.030982:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892109056 00000100:00100000:2.0:1788925221.030987:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892109056 00000100:00100000:2.0:1788925221.031033:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1788925221.031041:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892109056:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925221.031076:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892109056:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925221.031083:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00080000:3.0:1788925221.031378:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788925221.362515:0:8503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2c09be60 20000000:00000080:0.0:1788925221.362533:0:8503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e0d2e5d2000 uarg=0000000000000000 20000000:01000000:0.0:1788925221.363541:0:8503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788925221.363618:0:8503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788925221.363623:0:8503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788925221.365093:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788925221.372914:0:8503:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788925221.383112:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788925221.383166:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788925221.383221:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788925221.383238:0:8503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788925221.383257:0:8503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.383286:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d42045400/0xb29fc47e1a291281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29127a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.383305:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2912dc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.383311:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a2913a7 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.383320:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd3f expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.383326:0:8503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.383364:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd3f expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.383378:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd3f expref: 9 pid: 5831 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.383391:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875823911011328:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788925221.386024:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2913a7 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.386055:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2913a7 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.386070:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875823911011456:0@lo:104: 00000100:00100000:3.0:1788925221.387440:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788925221.387606:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a2912dc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.387633:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a2912dc expref: 18 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.387644:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875823911011584:0@lo:104: 00000100:00100000:3.0:1788925221.387676:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788925221.391837:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d42045400/0xb29fc47e1a291281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a29127a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.391854:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d42045400/0xb29fc47e1a291281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a29127a expref: 18 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.391869:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875823911011712:0@lo:104: 00000100:00100000:3.0:1788925221.391908:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e082d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925221.392066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925221.392092:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892109440 00000100:00100000:2.0:1788925221.392100:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892109440 00010000:00010000:2.0:1788925221.392145:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd3f expref: 10 pid: 5831 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925221.392175:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:2.0:1788925221.392184:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892109440:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788925221.392196:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925221.392202:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd3f expref: 10 pid: 5831 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.392214:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd3f expref: 10 pid: 5831 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925221.392246:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925221.392287:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892109440:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925221.392294:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00010000:00010000:3.0:1788925221.392966:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07d8da00/0xb29fc47e1a29146b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd3f expref: 9 pid: 5831 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.392982:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875823911011328:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788925221.396958:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788925221.397007:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925221.397034:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911011456 00000100:00100000:0.0:1788925221.397043:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911011456 00000100:00100000:0.0:1788925221.397089:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911011584 00000100:00100000:0.0:1788925221.397092:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911011584 00000100:00100000:0.0:1788925221.397103:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911011712 00000100:00100000:0.0:1788925221.397105:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911011712 00000100:00100000:0.0:1788925221.397132:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925221.397142:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+5:8503:x1875823911011456:12345-0@lo:104: 00010000:00010000:0.0:1788925221.397158:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397509:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925221.397516:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+5:8503:x1875823911011456:12345-0@lo:104: Request processed in 377us (10081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.397536:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925221.397564:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788925221.397570:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35446450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+4:8503:x1875823911011584:12345-0@lo:104: 00010000:00010000:0.0:1788925221.397579:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397618:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788925221.397624:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35446450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+4:8503:x1875823911011584:12345-0@lo:104: Request processed in 55us (9947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.397629:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788925221.397729:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788925221.397738:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8503:x1875823911011712:12345-0@lo:104: 00010000:00010000:0.0:1788925221.397766:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397797:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788925221.397802:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:76f68b46-a017-4297-a662-44212e04e46d+3:8503:x1875823911011712:12345-0@lo:104: Request processed in 67us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.397807:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788925221.397826:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788925221.397832:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397839:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9200 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925221.397843:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397863:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925221.397871:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925221.397876:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788925221.397918:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397925:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925221.397944:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397951:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d07ed9200/0xb29fc47e1a2913a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2913ae expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397962:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788925221.397966:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397971:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044000 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925221.397973:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.397979:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925221.397985:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925221.397995:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788925221.398007:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398012:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925221.398024:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398031:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d42044000/0xb29fc47e1a2912dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a2912e3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398040:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925221.398042:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398047:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045000 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925221.398050:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398056:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925221.398061:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925221.398066:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788925221.398078:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398084:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925221.398096:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398103:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d42045000/0xb29fc47e1a29127a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398127:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925221.398129:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925221.398131:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925221.398145:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911011840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925221.398178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925221.398221:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911011968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925221.398257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925221.398290:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925221.398296:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911012096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925221.398317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925221.398340:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911011840 00000100:00100000:0.0:1788925221.398355:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911011840 00010000:00010000:0.0:1788925221.398375:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913a7 expref: 19 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925221.398393:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911011968 00000100:00100000:0.0:1788925221.398396:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911011968 00010000:00010000:0.0:1788925221.398406:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2912dc expref: 20 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925221.398416:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911012096 00000100:00100000:0.0:1788925221.398419:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911012096 00010000:00010000:0.0:1788925221.398427:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d42045400/0xb29fc47e1a291281 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29127a expref: 21 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925221.398449:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788925221.398454:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+21:3305:x1875823911011840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925221.398463:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925221.398468:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2913a7 expref: 21 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398478:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2913a7 expref: 21 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398494:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925221.398520:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+21:3305:x1875823911011840:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.398526:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788925221.398542:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788925221.398548:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+20:3306:x1875823911011968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925221.398555:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925221.398559:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a2912dc expref: 20 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398568:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a2912dc expref: 20 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398577:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925221.398601:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+20:3306:x1875823911011968:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.398607:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788925221.398621:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925221.398634:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911012096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925221.398642:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925221.398646:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d42045400/0xb29fc47e1a291281 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29127a expref: 19 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398655:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d42045400/0xb29fc47e1a291281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a29127a expref: 19 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398666:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398675:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398689:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398696:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398702:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398707:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398725:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8dc00 already unused, calling callback (ffffffffc141f230) 00010000:00010000:0.0:1788925221.398729:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398736:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398781:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.398791:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925221.398814:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76f68b46-a017-4297-a662-44212e04e46d+19:3306:x1875823911012096:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.398820:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925221.398851:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911011840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925221.398876:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911012096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925221.398883:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:76f68b46-a017-4297-a662-44212e04e46d:3306:1875823911011968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788925221.399845:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925221.399928:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1788925221.403702:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d0148ae00/0xb29fc47e1a2913ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2913a7 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.403737:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875823911011456:0@lo:104: 00010000:00010000:3.0:1788925221.404412:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07d8d200/0xb29fc47e1a2912e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a2912dc expref: 17 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.404425:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875823911011584:0@lo:104: 00010000:00010000:3.0:1788925221.404437:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d42045400/0xb29fc47e1a291281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a29127a expref: 16 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925221.404465:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875823911011712:0@lo:104: 00010000:00010000:3.0:1788925221.404495:0:8503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.404504:0:8503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.404510:0:8503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925221.404517:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a29150c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925221.479169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925221.479250:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892109568 00000100:00100000:0.0:1788925221.479261:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892109568 00000100:00100000:0.0:1788925221.479321:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:0.0:1788925221.479332:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5624:x1875823892109568:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925221.479358:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925221.479378:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd7e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.479408:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd7e expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.479420:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd7e expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925221.479430:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00030400, rc 0) 00000100:00100000:0.0:1788925221.479482:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892109568:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 152us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.479496:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 174 00000100:00100000:3.0:1788925221.486430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925221.487924:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892109696 00000100:00100000:0.0:1788925221.487938:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892109696 00000100:00100000:0.0:1788925221.487999:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 175 00000100:00100000:0.0:1788925221.488010:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892109696:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925221.488296:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892109696:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 286us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.488304:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 175 00000100:00100000:0.0:1788925221.493482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925221.493572:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892109824 00000100:00100000:3.0:1788925221.493582:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892109824 00000100:00100000:3.0:1788925221.493632:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 176 00000100:00100000:3.0:1788925221.493642:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892109824:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925221.493885:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892109824:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 243us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.493893:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 176 00000100:00100000:2.0:1788925221.506258:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925221.506311:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892109952 00000100:00100000:3.0:1788925221.506330:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892109952 00000100:00100000:3.0:1788925221.506391:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:3.0:1788925221.506401:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:6141:x1875823892109952:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788925221.506866:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:6141:x1875823892109952:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 465us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925221.506882:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 177 00000100:00100000:2.0:1788925221.519277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925221.523352:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892110080 00000100:00100000:0.0:1788925221.523367:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892110080 00000100:00100000:0.0:1788925221.523441:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 178 00000100:00100000:0.0:1788925221.523452:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:6141:x1875823892110080:12345-192.168.203.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788925221.523730:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:6141:x1875823892110080:12345-192.168.203.4@tcp:502:llog_process_th.0 Request processed in 279us (4472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925221.523738:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 178 00010000:00010000:0.0:1788925221.953120:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925222.976828:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925222.977225:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925222.977244:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911012224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925222.977307:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.977363:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911012224 00000100:00100000:3.0:1788925222.977370:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911012224 00000100:00100000:3.0:1788925222.977418:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788925222.977427:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911012224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925222.977457:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925222.977496:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911012224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925222.977503:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788925222.977523:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788925222.977547:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2ea91c00 x1875823911012224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925222.977564:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911012224:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1788925223.041830:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788925223.041838:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d0b757000 from 4 10000000:01000000:0.0:1788925223.041843:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788925223.041896:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.041908:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.041920:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925223.041956:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911012352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788925223.042023:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925223.042074:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a04b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925223.042190:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911012352 00000100:00100000:3.0:1788925223.042198:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911012352 00000100:00100000:3.0:1788925223.042253:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788925223.042390:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823911012352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925223.042404:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925223.042417:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29151a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925223.042451:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29151a expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925223.042475:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29151a expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925223.042487:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8dc00, rc 0) 00000100:00100000:3.0:1788925223.042540:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911012352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925223.042547:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788925223.044022:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911012352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925223.044043:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.044054:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925223.044117:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911012480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925223.044160:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925223.044185:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a04b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925223.044371:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911012480 00000100:00100000:2.0:1788925223.044378:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911012480 00000100:00100000:2.0:1788925223.044419:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788925223.044428:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911012480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925223.044687:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911012480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925223.044695:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788925223.044836:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911012480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925223.044867:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911012608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925223.044904:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925223.044919:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a04b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788925223.044932:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911012608 00000100:00100000:0.0:1788925223.044936:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911012608 00000100:00100000:0.0:1788925223.044962:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788925223.044969:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911012608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925223.045108:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911012608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925223.045115:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788925223.045158:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911012608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925223.047932:0:8554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8554:1875823911012736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925223.048012:0:8554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925223.048039:0:8554:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d06a04000 going to sleep for 11 seconds 00000100:00100000:3.0:1788925223.049143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911012736 00000100:00100000:3.0:1788925223.049152:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911012736 00000100:00100000:3.0:1788925223.049208:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788925223.049218:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:8554:x1875823911012736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925223.049457:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:8554:x1875823911012736:12345-0@lo:502:llog_process_th.0 Request processed in 240us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925223.049466:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788925223.049595:0:8554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8554:1875823911012736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788925223.049628:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925223.049637:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925223.049639:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788925223.049646:0:8554:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0d0b757000 00000020:00000080:0.0:1788925223.049649:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788925223.049737:0:8554:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8554:1875823911012864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925223.049800:0:8554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925223.049830:0:8554:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d04dff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925223.049911:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911012864 00000100:00100000:1.0:1788925223.049916:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911012864 00000100:00100000:1.0:1788925223.049943:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788925223.049949:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:8554:x1875823911012864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925223.050076:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:8554:x1875823911012864:12345-0@lo:502:llog_process_th.0 Request processed in 126us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925223.050082:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788925223.050318:0:8554:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8554:1875823911012864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788925223.050348:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925223.050353:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925223.050354:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788925223.050358:0:8554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788925223.050560:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788925223.050579:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925223.050588:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925223.050610:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925223.050620:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788925223.050623:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d04b8b800 from 4 10000000:01000000:1.0:1788925223.050625:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925223.050648:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925223.050655:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925223.050664:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925223.050678:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911012992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925223.050722:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925223.050774:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d02b80600 going to sleep for 11 seconds 00000100:00100000:0.0:1788925223.050868:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911012992 00000100:00100000:0.0:1788925223.050873:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911012992 00000100:00100000:0.0:1788925223.050906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788925223.050914:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911012992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925223.050923:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925223.050933:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291528 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.050953:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291528 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.050970:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291528 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.050979:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00031800, rc 0) 00000100:00100000:0.0:1788925223.051011:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911012992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925223.051017:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788925223.051045:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911012992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925223.051057:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.051065:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925223.051103:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925223.051126:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925223.051138:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d04dff900 going to sleep for 11 seconds 00000100:00100000:0.0:1788925223.051148:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911013120 00000100:00100000:0.0:1788925223.051151:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911013120 00000100:00100000:0.0:1788925223.051172:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788925223.051178:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911013120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925223.051506:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911013120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925223.051513:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788925223.054482:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925223.054539:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925223.054602:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925223.054691:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d02b800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925223.056257:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911013248 00000100:00100000:0.0:1788925223.056269:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911013248 00000100:00100000:0.0:1788925223.056335:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788925223.056344:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911013248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925223.056655:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911013248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 311us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925223.056663:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788925223.056733:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925223.072284:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8556:1875823911013376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925223.072382:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925223.072421:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e085900 going to sleep for 11 seconds 00000100:00100000:0.0:1788925223.073585:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911013376 00000100:00100000:0.0:1788925223.073596:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911013376 00000100:00100000:0.0:1788925223.073641:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788925223.073651:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+18:8556:x1875823911013376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925223.073907:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+18:8556:x1875823911013376:12345-0@lo:502:llog_process_th.0 Request processed in 257us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925223.073919:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788925223.075396:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8556:1875823911013376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788925223.075437:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925223.075447:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925223.075450:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788925223.075457:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0d04b8b800 00000020:00000080:3.0:1788925223.075459:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788925223.075539:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8556:1875823911013504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925223.076895:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925223.076947:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1805dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925223.077606:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911013504 00000100:00100000:0.0:1788925223.077616:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911013504 00000100:00100000:0.0:1788925223.077662:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788925223.077671:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:8556:x1875823911013504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925223.077928:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:8556:x1875823911013504:12345-0@lo:502:llog_process_th.0 Request processed in 257us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925223.077936:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788925223.077993:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8556:1875823911013504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788925223.078025:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925223.078033:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925223.078035:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788925223.078040:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788925223.079150:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788925223.079175:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788925223.079184:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925223.079196:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925223.079205:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788925223.079208:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d1882f800 from 4 10000000:01000000:3.0:1788925223.079210:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788925223.079239:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925223.079246:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925223.079256:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925223.079277:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788925223.079407:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925223.079446:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1805d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788925223.080445:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911013632 00000100:00100000:2.0:1788925223.080455:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911013632 00000100:00100000:2.0:1788925223.080500:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788925223.080509:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911013632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925223.080521:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925223.080535:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291536 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925223.080559:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291536 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925223.080581:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291536 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925223.080590:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed9400, rc 0) 00000100:00100000:2.0:1788925223.080641:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911013632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925223.080648:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788925223.080697:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925223.080725:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925223.080735:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925223.080809:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925223.080837:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925223.080861:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10171540 going to sleep for 11 seconds 00000100:00100000:2.0:1788925223.080873:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911013760 00000100:00100000:2.0:1788925223.080877:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911013760 00000100:00100000:2.0:1788925223.080896:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788925223.080903:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911013760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925223.081117:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911013760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925223.081125:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788925223.081151:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925223.081185:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2e9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925223.081219:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925223.081232:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10171540 going to sleep for 11 seconds 00000100:00100000:2.0:1788925223.081243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911013888 00000100:00100000:2.0:1788925223.081247:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911013888 00000100:00100000:2.0:1788925223.081266:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788925223.081272:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d101a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911013888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925223.084867:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d101a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911013888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3586us (3639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925223.084882:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788925223.084962:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2e9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911013888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925223.095027:0:8560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8560:1875823911014016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925223.095104:0:8560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925223.095143:0:8560:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d02b80000 going to sleep for 11 seconds 00000100:00100000:2.0:1788925223.095976:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911014016 00000100:00100000:2.0:1788925223.095985:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911014016 00000100:00100000:2.0:1788925223.096029:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788925223.096038:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:8560:x1875823911014016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925223.096295:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:8560:x1875823911014016:12345-0@lo:502:llog_process_th.0 Request processed in 257us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925223.096303:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788925223.103880:0:8560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8560:1875823911014016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788925223.103948:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925223.103957:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925223.103960:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788925223.103965:0:8560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e0d1882f800 00000020:00000080:1.0:1788925223.103968:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788925223.104463:0:8560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8560:1875823911014144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925223.104532:0:8560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925223.104573:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911014144 00000100:00100000:1.0:1788925223.104579:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911014144 00000100:00100000:1.0:1788925223.104620:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788925223.104628:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:8560:x1875823911014144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925223.104857:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:8560:x1875823911014144:12345-0@lo:502:llog_process_th.0 Request processed in 228us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925223.104865:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788925223.104915:0:8560:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d02b80000 going to sleep for 11 seconds 00000100:00100000:1.0:1788925223.104929:0:8560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:76f68b46-a017-4297-a662-44212e04e46d:8560:1875823911014144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788925223.104950:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925223.104956:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925223.104958:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788925223.104961:0:8560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788925223.111883:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788925223.111930:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925223.111941:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.111952:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925224.004837:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925224.013033:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911014272:0@lo:400:kworker.0 00000100:00100000:3.0:1788925224.013136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925224.014424:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911014272 00000100:00100000:2.0:1788925224.014433:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911014272 00000100:00100000:2.0:1788925224.014489:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788925224.014498:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911014272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925224.020665:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911014400:0@lo:400:kworker.0 00000100:00100000:0.0:1788925224.020770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925224.020820:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925224.020827:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911014528:0@lo:400:kworker.0 00000100:00100000:0.0:1788925224.020855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925224.020896:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911014656:0@lo:400:kworker.0 00000100:00100000:0.0:1788925224.020920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925224.020962:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911014400 00000100:00100000:0.0:1788925224.020970:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911014400 00000100:00100000:0.0:1788925224.021012:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911014656 00000100:00100000:0.0:1788925224.021015:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911014656 00000100:00100000:0.0:1788925224.021036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788925224.021045:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911014400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925224.021098:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911014400:12345-0@lo:400:kworker.0 Request processed in 54us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925224.021105:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788925224.021123:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788925224.021129:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911014656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925224.021159:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911014656:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925224.021173:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788925224.021213:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911014656:0@lo:400:kworker.0 00000100:00100000:0.0:1788925224.021241:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911014400:0@lo:400:kworker.0 00000100:00100000:3.0:1788925224.021755:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911014528 00000100:00100000:3.0:1788925224.021761:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911014528 00000100:00100000:3.0:1788925224.021797:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925224.021805:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911014528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925224.021864:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911014528:12345-0@lo:400:kworker.0 Request processed in 60us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925224.021871:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788925224.021890:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925224.021894:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788925224.021986:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d0b6e6680 x1875823911014528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925224.021997:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911014528:0@lo:400:kworker.0 00000100:00100000:2.0:1788925224.022154:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911014272:12345-0@lo:400:kworker.0 Request processed in 7655us (9016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925224.022161:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788925224.026600:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911014272:0@lo:400:kworker.0 00000100:00100000:3.0:1788925224.027271:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911014784:0@lo:400:kworker.0 00000100:00100000:3.0:1788925224.027446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925224.027583:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911014784 00000100:00100000:2.0:1788925224.027591:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911014784 00000100:00100000:2.0:1788925224.027662:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925224.027672:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911014784:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788925224.027761:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788925224.032508:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911014784:12345-0@lo:400:kworker.0 Request processed in 4829us (5053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925224.032522:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788925224.043589:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d0b6e5c00 x1875823911014784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925224.043609:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911014784:0@lo:400:kworker.0 00000100:00100000:0.0:1788925224.515041:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911014912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925224.515118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925224.515281:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911014912 00000100:00100000:3.0:1788925224.515289:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911014912 00000100:00100000:3.0:1788925224.515340:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925224.515350:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911014912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925224.515385:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925224.515440:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911014912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925224.515447:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788925224.515560:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2ea90700 x1875823911014912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925224.515578:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911014912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788925225.024898:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925226.054089:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925226.152282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925226.152336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925226.152373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925226.152402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925226.152558:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892110464 00000100:00100000:1.0:1788925226.152570:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892110464 00000100:00100000:1.0:1788925226.152625:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892110592 00000100:00100000:1.0:1788925226.152629:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892110592 00000100:00100000:1.0:1788925226.152647:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1788925226.152656:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892110464:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925226.152769:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892110464:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925226.152789:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1788925226.152806:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788925226.152813:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892110592:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925226.152840:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892110592:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925226.152846:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00080000:1.0:1788925226.152861:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925226.152866:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925226.153011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892110208 00000100:00100000:3.0:1788925226.153016:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892110208 00000100:00100000:3.0:1788925226.153042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:3.0:1788925226.153049:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892110208:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925226.153084:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892110208:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925226.153100:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 194 00000100:00100000:2.0:1788925226.153190:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892110336 00000100:00100000:2.0:1788925226.153195:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892110336 00000100:00100000:2.0:1788925226.153241:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:2.0:1788925226.153247:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892110336:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925226.153283:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892110336:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 36us (909us total) trans 0 rc 0/0 00000100:00080000:3.0:1788925226.153371:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925226.153397:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00010000:00010000:2.0:1788925227.073100:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925228.101476:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911015040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925228.101567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925228.101641:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925228.101714:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911015040 00000100:00100000:3.0:1788925228.101722:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911015040 00000100:00100000:3.0:1788925228.101808:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925228.101818:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911015040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925228.101850:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925228.101897:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911015040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925228.101905:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788925228.101926:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788925228.109305:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2ea91c00 x1875823911015040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925228.109333:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911015040:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788925228.287499:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788925229.121292:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925229.124011:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925229.124085:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925229.124105:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911015296:0@lo:400:kworker.0 00000100:00100000:1.0:1788925229.124173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925229.124902:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911015296 00000100:00100000:2.0:1788925229.124910:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911015296 00000100:00100000:2.0:1788925229.124964:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788925229.124974:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911015296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925229.125041:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911015296:12345-0@lo:400:kworker.0 Request processed in 69us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925229.125048:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788925229.125116:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911015296:0@lo:400:kworker.0 00000100:00100000:0.0:1788925229.125313:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911015168:0@lo:400:kworker.0 00000100:00100000:0.0:1788925229.125350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925229.125433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911015168 00000100:00100000:1.0:1788925229.125437:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911015168 00000100:00100000:1.0:1788925229.125477:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788925229.125484:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911015168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925229.125525:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911015168:12345-0@lo:400:kworker.0 Request processed in 42us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925229.125532:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788925229.125572:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911015168:0@lo:400:kworker.0 00000100:00100000:1.0:1788925229.135827:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911015680:0@lo:400:kworker.0 00000100:00100000:1.0:1788925229.135914:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925229.135963:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925229.135970:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911015808:0@lo:400:kworker.0 00000100:00100000:1.0:1788925229.135997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925229.136030:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911015808 00000100:00100000:1.0:1788925229.136051:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911015808 00000100:00100000:1.0:1788925229.136103:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788925229.136111:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911015808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925229.136159:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911015808:12345-0@lo:400:kworker.0 Request processed in 48us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925229.136166:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788925229.136245:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788925229.136277:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1500 x1875823911015808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925229.136291:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911015808:0@lo:400:kworker.0 00000100:00100000:3.0:1788925229.137574:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911015680 00000100:00100000:3.0:1788925229.137582:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911015680 00000100:00100000:3.0:1788925229.137645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788925229.137655:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911015680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925229.137725:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911015680:12345-0@lo:400:kworker.0 Request processed in 72us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925229.137731:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788925229.137965:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911015552:0@lo:400:kworker.0 00000100:00100000:2.0:1788925229.138000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925229.138034:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925229.138041:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911015424:0@lo:400:kworker.0 00000100:00100000:2.0:1788925229.138062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925229.138193:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911015424 00000100:00100000:2.0:1788925229.138198:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911015424 00000100:00100000:2.0:1788925229.138226:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788925229.138233:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911015424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925229.138269:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911015424:12345-0@lo:400:kworker.0 Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925229.138275:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788925229.138308:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911015424:0@lo:400:kworker.0 00000100:00080000:1.0:1788925229.138953:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925229.138986:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911015680:0@lo:400:kworker.0 00000100:00100000:3.0:1788925229.139055:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911015552 00000100:00100000:3.0:1788925229.139061:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911015552 00000100:00100000:3.0:1788925229.139098:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788925229.139105:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911015552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925229.139160:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911015552:12345-0@lo:400:kworker.0 Request processed in 55us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925229.139166:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788925229.139249:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2ea93800 x1875823911015552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925229.139261:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911015552:0@lo:400:kworker.0 00000100:00100000:2.0:1788925229.633532:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925229.633556:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911015936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925229.633623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925229.633804:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911015936 00000100:00100000:3.0:1788925229.633813:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911015936 00000100:00100000:3.0:1788925229.633879:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925229.633890:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911015936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925229.633922:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925229.633973:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911015936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925229.633980:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788925229.635626:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1880 x1875823911015936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925229.635649:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911015936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925230.148027:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925231.170279:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925231.270965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925231.271008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925231.271097:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892110720 00000100:00100000:1.0:1788925231.271107:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892110720 00000100:00100000:1.0:1788925231.271161:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:1.0:1788925231.271171:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892110720:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925231.271255:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892110720:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 84us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925231.271275:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 196 00000100:00100000:3.0:1788925231.271909:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892110848 00000100:00100000:3.0:1788925231.271915:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892110848 00000100:00100000:3.0:1788925231.271970:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:3.0:1788925231.271978:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892110848:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925231.272031:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892110848:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 54us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925231.272038:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00080000:1.0:1788925231.272790:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925231.308881:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925231.308927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925231.309775:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892110976 00000100:00100000:3.0:1788925231.309790:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892110976 00000100:00100000:3.0:1788925231.309873:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892111104 00000100:00100000:3.0:1788925231.309877:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892111104 00000100:00100000:3.0:1788925231.309902:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788925231.309916:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2381:x1875823892110976:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:3.0:1788925231.309970:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb29fc47e1a291479 00000100:00080000:3.0:1788925231.309983:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9e0d41ee2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788925231.310040:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788925231.310857:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+2:2381:x1875823892110976:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 941us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925231.310890:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788925231.310914:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788925231.310927:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2381:x1875823892111104:12345-192.168.203.4@tcp:9:kworker.0 00000020:00000080:3.0:1788925231.310951:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb29fc47e1a291480 00000100:00080000:3.0:1788925231.310962:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9e0d41ee1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788925231.310988:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788925231.311196:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+2:2381:x1875823892111104:12345-192.168.203.4@tcp:9:kworker.0 Request processed in 273us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925231.311203:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00080000:2.0:1788925231.311466:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788925231.311472:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788925231.311504:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925231.311532:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925232.193846:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925233.217713:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925233.246168:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911016064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925233.247783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925233.249340:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911016064 00000100:00100000:3.0:1788925233.249351:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911016064 00000100:00080000:1.0:1788925233.249821:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925233.251283:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788925233.251298:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911016064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925233.251330:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925233.251888:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911016064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 592us (4108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925233.251897:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788925233.253486:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1880 x1875823911016064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925233.253514:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911016064:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788925233.283058:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da20ab87-237b-453b-b2c0-9c81ec453d80 00000020:00000080:3.0:1788925233.283068:0:6705:0:(genops.c:885:class_export_put()) final put ffff9e0d41ee5000/da20ab87-237b-453b-b2c0-9c81ec453d80 00000020:00000080:0.0:1788925233.283150:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e0d41ee5000/da20ab87-237b-453b-b2c0-9c81ec453d80 for lustre-OST0000 00000020:00000080:0.0:1788925233.283337:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e0d41ee2000 for lustre-OST0000 00010000:00010000:2.0:1788925234.241430:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925234.241967:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911016448:0@lo:400:kworker.0 00000100:00100000:0.0:1788925234.242032:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925234.242090:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925234.242097:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911016576:0@lo:400:kworker.0 00000100:00100000:0.0:1788925234.242124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925234.242162:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911016448 00000100:00100000:0.0:1788925234.242169:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911016448 00000100:00100000:0.0:1788925234.242231:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925234.242240:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911016448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925234.242289:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911016448:12345-0@lo:400:kworker.0 Request processed in 50us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925234.242297:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925234.242319:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911016576 00000100:00100000:0.0:1788925234.242323:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911016576 00000100:00100000:0.0:1788925234.242345:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925234.242351:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911016576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925234.242381:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911016576:12345-0@lo:400:kworker.0 Request processed in 30us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925234.242387:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788925234.242421:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d066b2d80 x1875823911016576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925234.242435:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911016576:0@lo:400:kworker.0 00000100:00100000:0.0:1788925234.242447:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911016448:0@lo:400:kworker.0 00000100:00100000:1.0:1788925234.242592:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911016192:0@lo:400:kworker.0 00000100:00100000:1.0:1788925234.242631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925234.242677:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911016704:0@lo:400:kworker.0 00000100:00100000:1.0:1788925234.242701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925234.242724:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788925234.242730:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911016320:0@lo:400:kworker.0 00000100:00100000:1.0:1788925234.242774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925234.242794:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911016832:0@lo:400:kworker.0 00000100:00100000:1.0:1788925234.242816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788925234.242843:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925234.242854:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911016832 00000100:00100000:1.0:1788925234.242857:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911016832 00000100:00100000:1.0:1788925234.242887:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788925234.242895:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911016832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925234.242931:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911016832:12345-0@lo:400:kworker.0 Request processed in 37us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925234.242937:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788925234.242954:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911016704 00000100:00100000:1.0:1788925234.242957:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911016704 00000100:00100000:1.0:1788925234.242978:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911016320 00000100:00100000:1.0:1788925234.242982:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911016320 00000100:00100000:1.0:1788925234.242997:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788925234.243002:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911016704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925234.243047:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911016704:12345-0@lo:400:kworker.0 Request processed in 44us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925234.243053:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788925234.243063:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788925234.243069:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925234.243093:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911016320:12345-0@lo:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925234.243098:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788925234.243119:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925234.243122:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788925234.243141:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911016320:0@lo:400:kworker.0 00010000:00080000:1.0:1788925234.243150:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d066b0700 x1875823911016832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925234.243159:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911016832:0@lo:400:kworker.0 00000100:00100000:1.0:1788925234.243168:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911016704:0@lo:400:kworker.0 00000100:00100000:0.0:1788925234.243348:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911016192 00000100:00100000:0.0:1788925234.243358:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911016192 00000100:00100000:0.0:1788925234.243391:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788925234.243397:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911016192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925234.243431:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911016192:12345-0@lo:400:kworker.0 Request processed in 34us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925234.243438:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788925234.243628:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911016192:0@lo:400:kworker.0 00000100:00100000:3.0:1788925234.752989:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925234.753009:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911016960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925234.753146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925234.753213:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911016960 00000100:00100000:3.0:1788925234.753229:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911016960 00000100:00100000:3.0:1788925234.753273:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788925234.753282:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911016960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925234.753314:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925234.753360:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911016960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925234.753367:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788925234.753409:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ffc1880 x1875823911016960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925234.753428:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ffc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911016960:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788925235.171600:0:9047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing yml_node 00010000:00010000:3.0:1788925235.268510:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788925235.874997:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da20ab87-237b-453b-b2c0-9c81ec453d80 00000020:00000080:0.0:1788925235.875005:0:7636:0:(genops.c:885:class_export_put()) final put ffff9e0d41ee4000/da20ab87-237b-453b-b2c0-9c81ec453d80 00000020:00000080:3.0:1788925235.875064:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e0d41ee4000/da20ab87-237b-453b-b2c0-9c81ec453d80 for lustre-OST0001 00000020:00000080:3.0:1788925235.875328:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e0d41ee1800 for lustre-OST0001 00010000:00010000:2.0:1788925236.289838:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925236.393238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925236.393269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925236.394787:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892111232 00000100:00100000:2.0:1788925236.394800:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892111232 00000100:00100000:2.0:1788925236.394859:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 198 00000100:00100000:1.0:1788925236.394911:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892111360 00000100:00100000:1.0:1788925236.394916:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892111360 00000100:00100000:1.0:1788925236.394958:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:1.0:1788925236.394967:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892111360:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925236.395044:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892111360:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 78us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925236.395051:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00080000:1.0:1788925236.395072:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925236.395796:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892111232:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925236.395845:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892111232:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 55us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.403424:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 198 00010000:00010000:3.0:1788925237.312975:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925238.336903:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925238.337383:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925238.337403:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911017088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925238.337473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925238.339375:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911017088 00000100:00100000:1.0:1788925238.339388:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911017088 00000100:00080000:2.0:1788925238.339453:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925238.339459:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788925238.339470:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911017088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925238.339506:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925238.339665:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911017088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925238.339673:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788925238.340316:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dfca80 x1875823911017088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925238.340341:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911017088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788925239.361118:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925239.362670:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911017472:0@lo:400:kworker.0 00000100:00100000:0.0:1788925239.362729:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911017600:0@lo:400:kworker.0 00000100:00100000:1.0:1788925239.362734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.362825:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911017216:0@lo:400:kworker.0 00000100:00100000:3.0:1788925239.362877:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911017344:0@lo:400:kworker.0 00000100:00100000:0.0:1788925239.363059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925239.363120:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911017600 00000100:00100000:0.0:1788925239.363127:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911017600 00000100:00100000:0.0:1788925239.363404:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788925239.363415:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911017600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925239.363466:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911017600:12345-0@lo:400:kworker.0 Request processed in 53us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.363473:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788925239.363577:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d0b6e4a80 x1875823911017600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925239.363590:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911017600:0@lo:400:kworker.0 00000100:00100000:0.0:1788925239.363633:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911017472 00000100:00100000:0.0:1788925239.363637:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911017472 00000100:00100000:0.0:1788925239.363672:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788925239.363694:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911017472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925239.363731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911017472:12345-0@lo:400:kworker.0 Request processed in 38us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.363736:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788925239.363774:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925239.377126:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911017472:0@lo:400:kworker.0 00000100:00100000:2.0:1788925239.377266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925239.377318:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911017728:0@lo:400:kworker.0 00000100:00100000:2.0:1788925239.377469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925239.377616:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911017216 00000100:00100000:1.0:1788925239.377623:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911017216 00000100:00100000:1.0:1788925239.377674:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788925239.377684:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911017216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925239.377737:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911017216:12345-0@lo:400:kworker.0 Request processed in 54us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.377769:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788925239.378230:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911017216:0@lo:400:kworker.0 00000100:00100000:0.0:1788925239.381412:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911017728 00000100:00100000:0.0:1788925239.382080:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911017728 00000100:00080000:2.0:1788925239.382264:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925239.382511:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788925239.382525:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911017728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925239.382633:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911017728:12345-0@lo:400:kworker.0 Request processed in 112us (5164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925239.382641:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788925239.382708:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911017728:0@lo:400:kworker.0 00000100:00100000:3.0:1788925239.382996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.384919:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911017856:0@lo:400:kworker.0 00000100:00100000:3.0:1788925239.384976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.385034:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911017856 00000100:00100000:3.0:1788925239.385041:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911017856 00000100:00100000:3.0:1788925239.385091:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788925239.385101:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911017856:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788925239.385241:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925239.385273:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911017856:12345-0@lo:400:kworker.0 Request processed in 64us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.385289:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788925239.385327:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d0b6e4e00 x1875823911017856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925239.385477:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911017856:0@lo:400:kworker.0 00000100:00100000:1.0:1788925239.387083:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911017344 00000100:00100000:1.0:1788925239.387093:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911017344 00000100:00100000:1.0:1788925239.387156:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788925239.387730:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911017344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925239.387841:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911017344:12345-0@lo:400:kworker.0 Request processed in 677us (4845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925239.387849:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788925239.387974:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911017344:0@lo:400:kworker.0 00000100:00100000:0.0:1788925239.873002:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788925239.873027:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911017984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925239.873099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925239.873222:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911017984 00000100:00100000:3.0:1788925239.873230:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911017984 00000100:00100000:3.0:1788925239.873286:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925239.873296:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911017984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925239.873343:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925239.873395:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911017984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925239.873401:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788925239.873440:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dff800 x1875823911017984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925239.873457:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911017984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788925240.392687:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925240.683284:0:9240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.56 00010000:00010000:3.0:1788925241.409038:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925241.533649:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925241.533811:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925241.534725:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892111488 00000100:00100000:2.0:1788925241.534788:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892111488 00000100:00100000:2.0:1788925241.534871:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 200 00000100:00100000:2.0:1788925241.534885:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892111488:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925241.535004:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892111488:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 121us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925241.535013:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 200 00000100:00100000:3.0:1788925241.545699:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892111616 00000100:00100000:3.0:1788925241.545722:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892111616 00000100:00100000:3.0:1788925241.545876:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:3.0:1788925241.545890:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892111616:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925241.546011:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892111616:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 124us (12956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925241.546032:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00080000:2.0:1788925241.546402:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925242.435413:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925243.460038:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911018112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925243.460105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925243.462005:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911018112 00000100:00100000:1.0:1788925243.462015:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911018112 00000100:00080000:3.0:1788925243.462040:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925243.462061:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788925243.462069:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911018112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925243.462097:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925243.462162:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911018112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925243.462167:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788925243.462433:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dff800 x1875823911018112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925243.462454:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911018112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788925243.470667:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788925244.183733:0:9337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.56 00010000:00010000:3.0:1788925244.481219:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925244.481638:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911018496:0@lo:400:kworker.0 00000100:00100000:0.0:1788925244.481638:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911018368:0@lo:400:kworker.0 00000100:00100000:3.0:1788925244.481780:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911018240:0@lo:400:kworker.0 00000100:00100000:1.0:1788925244.481866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925244.481986:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925244.481992:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911018624:0@lo:400:kworker.0 00000100:00100000:1.0:1788925244.482018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925244.482055:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911018624 00000100:00100000:1.0:1788925244.482062:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911018624 00000100:00100000:1.0:1788925244.482103:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788925244.482111:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911018624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925244.482161:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911018624:12345-0@lo:400:kworker.0 Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925244.482167:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788925244.482198:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d0b6e4e00 x1875823911018624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925244.482212:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911018624:0@lo:400:kworker.0 00000100:00100000:2.0:1788925244.482294:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911018496 00000100:00100000:2.0:1788925244.482298:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911018496 00000100:00100000:2.0:1788925244.482350:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788925244.482357:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911018496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925244.482394:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911018496:12345-0@lo:400:kworker.0 Request processed in 37us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925244.482400:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788925244.482426:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911018496:0@lo:400:kworker.0 00000100:00080000:1.0:1788925244.482500:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925244.485099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925244.485618:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911018880:0@lo:400:kworker.0 00000100:00100000:0.0:1788925244.485652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925244.485697:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911018368 00000100:00100000:0.0:1788925244.485705:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911018368 00000100:00100000:0.0:1788925244.485763:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788925244.485773:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911018368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925244.485826:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911018368:12345-0@lo:400:kworker.0 Request processed in 54us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925244.485842:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788925244.486044:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911018880 00000100:00100000:1.0:1788925244.486049:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911018880 00000100:00100000:1.0:1788925244.486085:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788925244.486092:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911018880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925244.486238:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911018880:12345-0@lo:400:kworker.0 Request processed in 147us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925244.486245:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788925244.486261:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925244.487095:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911018368:0@lo:400:kworker.0 00010000:00080000:0.0:1788925244.487122:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d0b6e5180 x1875823911018880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925244.487133:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911018880:0@lo:400:kworker.0 00000100:00100000:3.0:1788925244.490030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925244.491027:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911018752:0@lo:400:kworker.0 00000100:00100000:3.0:1788925244.491076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925244.491175:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911018752 00000100:00100000:0.0:1788925244.491184:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911018752 00000100:00100000:0.0:1788925244.491249:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788925244.491258:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911018752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925244.491320:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911018752:12345-0@lo:400:kworker.0 Request processed in 62us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925244.491327:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788925244.491492:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925244.491522:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911018752:0@lo:400:kworker.0 00000100:00100000:1.0:1788925244.492414:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911018240 00000100:00100000:1.0:1788925244.492422:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911018240 00000100:00100000:1.0:1788925244.493414:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788925244.493430:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911018240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925244.493517:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911018240:12345-0@lo:400:kworker.0 Request processed in 92us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925244.493525:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788925244.493629:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911018240:0@lo:400:kworker.0 00000100:00100000:0.0:1788925244.995140:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911019008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925244.995205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925244.995381:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911019008 00000100:00100000:3.0:1788925244.995389:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911019008 00000100:00100000:3.0:1788925244.995437:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788925244.995447:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911019008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925244.995477:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925244.995520:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911019008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925244.995526:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788925244.995558:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dfed80 x1875823911019008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925244.995596:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911019008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925245.505166:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925246.528997:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925246.657205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925246.657266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925246.657369:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892111872 00000100:00100000:0.0:1788925246.657381:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892111872 00000100:00100000:0.0:1788925246.657476:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:0.0:1788925246.657489:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892111872:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925246.657603:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892111872:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 117us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925246.657627:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:3.0:1788925246.658128:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892111744 00000100:00100000:3.0:1788925246.658135:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892111744 00000100:00100000:3.0:1788925246.658193:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00100000:3.0:1788925246.658202:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892111744:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925246.658252:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892111744:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 51us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925246.658259:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 202 00000100:00080000:1.0:1788925246.658864:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925247.567551:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925247.870803:0:9435:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.56 00010000:00010000:1.0:1788925248.581468:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925248.583223:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925248.583244:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911019136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925248.583313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925248.583740:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911019136 00000100:00100000:0.0:1788925248.583770:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911019136 00000100:00100000:0.0:1788925248.583860:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788925248.583873:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911019136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925248.583907:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925248.583967:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911019136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925248.583974:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788925248.584076:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788925248.584191:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d066b0700 x1875823911019136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925248.584211:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911019136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925249.601665:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911019520:0@lo:400:kworker.0 00000100:00100000:3.0:1788925249.602259:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911019264:0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.602309:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911019392:0@lo:400:kworker.0 00000100:00100000:3.0:1788925249.602311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925249.602386:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911019776:0@lo:400:kworker.0 00000100:00100000:0.0:1788925249.602415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925249.602667:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911019264 00000100:00100000:2.0:1788925249.602677:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911019264 00000100:00100000:2.0:1788925249.602736:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788925249.602767:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911019264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.607665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925249.608731:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911019904:0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.609013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925249.609101:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911019904 00000100:00100000:1.0:1788925249.609110:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911019904 00000100:00100000:1.0:1788925249.609178:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788925249.609189:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911019904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.609254:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911019904:12345-0@lo:400:kworker.0 Request processed in 67us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925249.609262:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788925249.609286:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788925249.609324:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d34e96680 x1875823911019904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925249.609341:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911019904:0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.609998:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911019520 00000100:00100000:1.0:1788925249.610006:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911019520 00000100:00100000:1.0:1788925249.610048:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911019392 00000100:00100000:1.0:1788925249.610052:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911019392 00000100:00100000:1.0:1788925249.610074:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925249.610081:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911019520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.610132:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911019520:12345-0@lo:400:kworker.0 Request processed in 51us (8344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925249.610138:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925249.610152:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788925249.610157:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911019392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.610191:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911019392:12345-0@lo:400:kworker.0 Request processed in 34us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925249.610197:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788925249.610238:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911019648:0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.610273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925249.610309:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911019648 00000100:00100000:1.0:1788925249.610313:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911019648 00000100:00100000:1.0:1788925249.610337:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788925249.610344:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911019648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.610384:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911019648:12345-0@lo:400:kworker.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925249.610390:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788925249.610405:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788925249.610425:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d06a9c380 x1875823911019648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925249.610436:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911019648:0@lo:400:kworker.0 00000100:00100000:1.0:1788925249.610465:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911019392:0@lo:400:kworker.0 00000100:00100000:3.0:1788925249.610955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788925249.611008:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925249.611038:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911019776 00000100:00100000:3.0:1788925249.611043:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911019776 00000100:00100000:3.0:1788925249.611078:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788925249.611086:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911019776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925249.611140:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911019776:12345-0@lo:400:kworker.0 Request processed in 56us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925249.611147:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788925249.611162:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925249.611181:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911019776:0@lo:400:kworker.0 00000100:00100000:0.0:1788925249.611369:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911019520:0@lo:400:kworker.0 00000100:00100000:0.0:1788925249.611621:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911019264:12345-0@lo:400:kworker.0 Request processed in 8856us (9308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925249.611630:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788925249.611758:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911019264:0@lo:400:kworker.0 00000100:00100000:0.0:1788925250.116125:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788925250.116157:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911020032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925250.116262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925250.116344:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911020032 00000100:00100000:0.0:1788925250.116353:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911020032 00000100:00100000:0.0:1788925250.116412:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788925250.116424:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911020032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788925250.116471:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925250.116530:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911020032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925250.116547:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788925250.116595:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d34e95f80 x1875823911020032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925250.116618:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911020032:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788925250.260056:0:9483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Tue Sep 8 23:40:48 EDT 2026 00010000:00010000:0.0:1788925250.624943:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925251.650224:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925251.750661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925251.750716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925251.750846:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892112000 00000100:00100000:0.0:1788925251.750860:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892112000 00000100:00100000:0.0:1788925251.750929:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:0.0:1788925251.750940:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892112000:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925251.751023:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892112000:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925251.751031:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 204 00000100:00100000:3.0:1788925251.751234:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892112128 00000100:00100000:3.0:1788925251.751239:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892112128 00000100:00100000:3.0:1788925251.751293:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00100000:3.0:1788925251.751301:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892112128:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925251.751343:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892112128:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 44us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925251.751351:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 57 00000100:00080000:1.0:1788925251.751455:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788925252.674356:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925253.698107:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911020160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925253.698191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925253.698471:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911020160 00000100:00100000:0.0:1788925253.698480:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911020160 00000100:00100000:0.0:1788925253.698554:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925253.698564:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911020160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925253.698596:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925253.698645:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911020160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.698652:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788925253.698691:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d34e95f80 x1875823911020160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925253.698710:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911020160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788925253.698834:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788925253.699346:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788925254.721462:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925254.721594:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911020416:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.721665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.721719:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911020928:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.721780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.721815:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788925254.721821:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911020288:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.721860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.721897:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911020800:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.721919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.721952:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911020544:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.722005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.722025:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925254.722029:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911020672:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.722047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.722099:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911020416 00000100:00100000:1.0:1788925254.722106:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911020416 00000100:00100000:1.0:1788925254.722404:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911020800 00000100:00100000:1.0:1788925254.722408:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911020800 00000100:00100000:1.0:1788925254.722432:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911020544 00000100:00100000:1.0:1788925254.722435:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911020544 00000100:00100000:1.0:1788925254.722450:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788925254.722458:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911020416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.722548:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911020416:12345-0@lo:400:kworker.0 Request processed in 90us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.722555:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788925254.722571:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788925254.722578:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911020800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.722606:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911020800:12345-0@lo:400:kworker.0 Request processed in 29us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.722611:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788925254.722622:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788925254.722627:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911020544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.722674:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911020544:12345-0@lo:400:kworker.0 Request processed in 47us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.722680:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788925254.722700:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911020928 00000100:00100000:1.0:1788925254.722725:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911020928 00000100:00100000:1.0:1788925254.722770:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911020672 00000100:00100000:1.0:1788925254.722774:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911020672 00000100:00100000:1.0:1788925254.722786:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788925254.722792:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911020928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.722822:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911020928:12345-0@lo:400:kworker.0 Request processed in 30us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.722827:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788925254.722838:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788925254.722842:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911020672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.722865:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911020672:12345-0@lo:400:kworker.0 Request processed in 23us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.722869:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788925254.722899:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911020288 00000100:00100000:1.0:1788925254.722903:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911020288 00000100:00100000:1.0:1788925254.722939:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788925254.722947:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.723000:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911020288:12345-0@lo:400:kworker.0 Request processed in 47us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.723006:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:1.0:1788925254.723057:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925254.723061:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925254.730585:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911020288:0@lo:400:kworker.0 00010000:00080000:1.0:1788925254.733719:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d066b0700 x1875823911020672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925254.733756:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911020672:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.733778:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911020544:0@lo:400:kworker.0 00000100:00100000:0.0:1788925254.734894:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911020800:0@lo:400:kworker.0 00000100:00100000:0.0:1788925254.734910:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911020416:0@lo:400:kworker.0 00010000:00080000:0.0:1788925254.734922:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d06a9d500 x1875823911020928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925254.735053:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d06a9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911020928:0@lo:400:kworker.0 00000100:00100000:2.0:1788925255.243815:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925255.243842:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911021056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925255.243913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925255.243998:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911021056 00000100:00100000:2.0:1788925255.244006:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911021056 00000100:00100000:2.0:1788925255.244050:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788925255.244059:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911021056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925255.244098:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925255.244143:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911021056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925255.244150:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788925255.244189:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dfe680 x1875823911021056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925255.244207:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911021056:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925255.748415:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925256.769919:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925256.869901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925256.870117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892112256 00000100:00100000:3.0:1788925256.870128:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892112256 00000100:00100000:3.0:1788925256.870187:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:3.0:1788925256.870199:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892112256:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925256.870287:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892112256:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 91us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925256.870296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 206 00000100:00100000:3.0:1788925256.871567:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925256.871643:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892112384 00000100:00100000:1.0:1788925256.871651:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892112384 00000100:00100000:1.0:1788925256.871722:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00100000:1.0:1788925256.871732:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892112384:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925256.871833:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892112384:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925256.871840:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 61 00000100:00080000:2.0:1788925256.871964:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925257.796558:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925258.817080:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911021184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925258.817148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925258.817594:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911021184 00000100:00100000:3.0:1788925258.817603:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911021184 00000100:00100000:3.0:1788925258.817673:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788925258.817684:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911021184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925258.817719:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925258.817810:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911021184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925258.817835:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788925258.817889:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d34e95f80 x1875823911021184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925258.817909:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911021184:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788925258.817997:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788925258.818469:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925259.841269:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925259.841404:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911021312:0@lo:400:kworker.0 00000100:00100000:2.0:1788925259.841472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925259.841568:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911021312 00000100:00100000:3.0:1788925259.841575:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911021312 00000100:00100000:3.0:1788925259.841617:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788925259.841626:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911021312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.842158:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911021440:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.842193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925259.842340:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911021440 00000100:00100000:0.0:1788925259.842345:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911021440 00000100:00100000:0.0:1788925259.842371:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788925259.842378:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911021440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.842415:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911021440:12345-0@lo:400:kworker.0 Request processed in 37us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925259.842422:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788925259.842459:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911021440:0@lo:400:kworker.0 00000100:00100000:3.0:1788925259.842912:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911021312:12345-0@lo:400:kworker.0 Request processed in 1286us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925259.842920:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788925259.843101:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925259.843112:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911021568:0@lo:400:kworker.0 00000100:00100000:1.0:1788925259.843144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925259.843176:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911021568 00000100:00100000:1.0:1788925259.843180:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911021568 00000100:00100000:1.0:1788925259.843215:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788925259.843221:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911021568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925259.843257:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911021568:12345-0@lo:400:kworker.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925259.843263:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788925259.843278:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925259.843311:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911021568:0@lo:400:kworker.0 00000100:00100000:1.0:1788925259.843340:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911021696:0@lo:400:kworker.0 00000100:00100000:1.0:1788925259.843380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925259.843407:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911021696 00000100:00100000:1.0:1788925259.843411:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911021696 00000100:00100000:1.0:1788925259.843434:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788925259.843441:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911021696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925259.843472:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911021696:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925259.843478:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788925259.843517:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ac6d180 x1875823911021696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925259.843527:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911021696:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.843969:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911021952:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.844002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925259.844031:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925259.844046:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911021824:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.844069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925259.844184:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911021824 00000100:00100000:3.0:1788925259.844189:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911021824 00000100:00100000:3.0:1788925259.844233:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788925259.844241:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d0b6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911021824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925259.844279:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d0b6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911021824:12345-0@lo:400:kworker.0 Request processed in 40us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925259.844286:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788925259.844313:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911021824:0@lo:400:kworker.0 00000100:00080000:0.0:1788925259.844365:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925259.844410:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911021952 00000100:00100000:1.0:1788925259.844414:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911021952 00000100:00100000:1.0:1788925259.844454:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788925259.844461:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911021952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925259.844510:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911021952:12345-0@lo:400:kworker.0 Request processed in 49us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925259.844515:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788925259.844538:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ac6ca80 x1875823911021952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925259.844547:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911021952:0@lo:400:kworker.0 00000100:00080000:0.0:1788925259.844768:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788925259.844935:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911021312:0@lo:400:kworker.0 00000100:00100000:1.0:1788925260.354200:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911022080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925260.354271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925260.354377:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911022080 00000100:00100000:3.0:1788925260.354386:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911022080 00000100:00100000:3.0:1788925260.354442:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788925260.354451:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911022080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925260.354494:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925260.354554:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911022080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925260.354560:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788925260.354598:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dfdc00 x1875823911022080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925260.354617:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911022080:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788925260.867397:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925261.889009:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925261.993014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925261.993061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925261.993147:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892112640 00000100:00100000:1.0:1788925261.993170:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892112640 00000100:00100000:1.0:1788925261.993234:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:1.0:1788925261.993244:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892112640:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925261.993313:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892112640:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 69us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925261.993321:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 65 00000100:00100000:3.0:1788925261.993405:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892112512 00000100:00100000:3.0:1788925261.993410:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892112512 00000100:00100000:3.0:1788925261.993454:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 208 00000100:00100000:3.0:1788925261.993461:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892112512:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925261.993499:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892112512:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 38us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925261.993505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 208 00000100:00080000:2.0:1788925261.993945:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788925262.914211:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925263.937134:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d0b6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911022208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925263.937437:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925263.937484:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911022208 00000100:00100000:3.0:1788925263.937492:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911022208 00000100:00100000:3.0:1788925263.937551:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788925263.937560:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911022208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925263.937589:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925263.937631:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911022208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925263.937638:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788925263.937916:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d0b6e6d80 x1875823911022208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925263.938022:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d0b6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911022208:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788925263.940046:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788925263.942502:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925264.961911:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911022336:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925264.962080:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911022848:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925264.962143:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788925264.962149:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911022464:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925264.962193:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911022976:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925264.962253:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911022592:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925264.962299:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925264.962304:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911022720:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925264.962364:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911022336 00000100:00100000:0.0:1788925264.962373:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911022336 00000100:00100000:0.0:1788925264.962430:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788925264.962440:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911022336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962515:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911022336:12345-0@lo:400:kworker.0 Request processed in 76us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925264.962522:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788925264.962560:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911022848 00000100:00100000:0.0:1788925264.962564:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911022848 00000100:00100000:0.0:1788925264.962608:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911022464 00000100:00100000:0.0:1788925264.962612:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911022464 00000100:00100000:0.0:1788925264.962625:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911022592 00000100:00100000:0.0:1788925264.962627:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911022592 00000100:00100000:0.0:1788925264.962643:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788925264.962649:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911022848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962682:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911022848:12345-0@lo:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925264.962688:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788925264.962700:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788925264.962705:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911022464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962729:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911022464:12345-0@lo:400:kworker.0 Request processed in 24us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925264.962735:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788925264.962771:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788925264.962777:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911022592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962808:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911022592:12345-0@lo:400:kworker.0 Request processed in 32us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925264.962815:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788925264.962838:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911022976 00000100:00100000:0.0:1788925264.962842:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911022976 00000100:00100000:0.0:1788925264.962867:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911022720 00000100:00100000:0.0:1788925264.962870:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911022720 00000100:00100000:0.0:1788925264.962885:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788925264.962891:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911022976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962922:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911022976:12345-0@lo:400:kworker.0 Request processed in 31us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925264.962938:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788925264.962950:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788925264.962955:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911022720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.962999:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911022720:12345-0@lo:400:kworker.0 Request processed in 43us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925264.963006:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788925264.963061:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d4192f100 x1875823911022720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925264.963079:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911022720:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.963093:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911022592:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.963125:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911022464:0@lo:400:kworker.0 00010000:00080000:0.0:1788925264.963135:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d4192d880 x1875823911022976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925264.963144:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911022976:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.963152:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911022336:0@lo:400:kworker.0 00000100:00100000:0.0:1788925264.963160:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911022848:0@lo:400:kworker.0 00000100:00080000:3.0:1788925264.965824:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925264.965839:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788925264.973855:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925265.476362:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925265.476386:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911023104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925265.476480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925265.476553:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911023104 00000100:00100000:3.0:1788925265.476560:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911023104 00000100:00100000:3.0:1788925265.476612:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788925265.476622:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911023104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925265.476656:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925265.476701:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911023104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925265.476709:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788925265.476732:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d4192c380 x1875823911023104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925265.476772:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911023104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925265.995013:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925267.009537:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925267.123811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925267.123863:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925267.124061:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892112896 00000100:00100000:3.0:1788925267.124075:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892112896 00000100:00100000:3.0:1788925267.124178:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:3.0:1788925267.124192:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892112896:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925267.124290:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892112896:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 101us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925267.124298:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00080000:0.0:1788925267.124803:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925267.124921:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892112768 00000100:00100000:1.0:1788925267.124928:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892112768 00000100:00100000:1.0:1788925267.124976:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 210 00000100:00100000:1.0:1788925267.124985:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892112768:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925267.125040:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892112768:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 57us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925267.125048:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 210 00010000:00010000:3.0:1788925268.033600:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925269.072653:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911023232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925269.072769:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925269.072866:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911023232 00000100:00100000:0.0:1788925269.072876:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911023232 00000100:00100000:0.0:1788925269.072957:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788925269.072968:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911023232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925269.073014:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925269.073065:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911023232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925269.073073:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788925269.073098:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788925269.073131:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d4192c700 x1875823911023232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925269.073153:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911023232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788925269.091848:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925270.082914:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911023360:0@lo:400:kworker.0 00000100:00100000:2.0:1788925270.083167:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911023488:0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.083307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.083311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925270.083372:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911024000:0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.083380:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911023872:0@lo:400:kworker.0 00000100:00100000:2.0:1788925270.083398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925270.083415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925270.083453:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911023616:0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.083478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925270.083503:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925270.083509:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911023744:0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.083554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925270.083589:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911023488 00000100:00100000:0.0:1788925270.083599:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911023488 00000100:00100000:0.0:1788925270.083652:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911023872 00000100:00100000:0.0:1788925270.083655:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911023872 00000100:00100000:0.0:1788925270.083679:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911023616 00000100:00100000:0.0:1788925270.083682:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911023616 00000100:00100000:0.0:1788925270.083701:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788925270.083710:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911023488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.083806:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911023488:12345-0@lo:400:kworker.0 Request processed in 96us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.083814:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788925270.083831:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788925270.083837:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911023872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.083868:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911023872:12345-0@lo:400:kworker.0 Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.083873:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788925270.083883:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788925270.083903:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911023616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.083933:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911023616:12345-0@lo:400:kworker.0 Request processed in 44us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.083938:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788925270.083955:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911024000 00000100:00100000:0.0:1788925270.083958:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911024000 00000100:00100000:0.0:1788925270.083981:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911023744 00000100:00100000:0.0:1788925270.083984:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911023744 00000100:00100000:0.0:1788925270.084104:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788925270.084113:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911024000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.084156:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911024000:12345-0@lo:400:kworker.0 Request processed in 45us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925270.084160:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911023488:0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.084163:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788925270.084174:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dff480 x1875823911024000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925270.084174:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788925270.084180:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911023744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925270.084185:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911024000:0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.084313:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911023744:12345-0@lo:400:kworker.0 Request processed in 133us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.084319:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788925270.084350:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788925270.084355:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788925270.084375:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dfd880 x1875823911023744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925270.084383:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911023744:0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.084392:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911023616:0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.084413:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911023872:0@lo:400:kworker.0 00000100:00100000:3.0:1788925270.087695:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911023360 00000100:00100000:3.0:1788925270.087711:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911023360 00000100:00100000:0.0:1788925270.087939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788925270.087954:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911023360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925270.088086:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911023360:12345-0@lo:400:kworker.0 Request processed in 136us (4778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.088094:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788925270.088848:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911023360:0@lo:400:kworker.0 00010000:00010000:3.0:1788925270.147334:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925270.594119:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911024128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925270.594213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925270.595302:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911024128 00000100:00100000:0.0:1788925270.595315:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911024128 00000100:00100000:0.0:1788925270.595382:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788925270.595399:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911024128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788925270.595465:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925270.595551:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911024128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925270.595558:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788925270.595908:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d4192f100 x1875823911024128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925270.595931:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911024128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788925271.169163:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925272.193723:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925272.233669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925272.233786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925272.234157:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892113152 00000100:00100000:2.0:1788925272.234171:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892113152 00000100:00100000:2.0:1788925272.234273:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00100000:2.0:1788925272.234286:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892113152:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925272.234383:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892113152:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 98us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925272.234392:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 73 00000100:00080000:0.0:1788925272.234632:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925272.235176:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892113024 00000100:00100000:3.0:1788925272.235192:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892113024 00000100:00100000:3.0:1788925272.235253:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 212 00000100:00100000:3.0:1788925272.235262:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892113024:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925272.235316:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892113024:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 55us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925272.235323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 212 00000001:02000400:1.0:1788925273.070302:0:10212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34683192 <= 34618625) for LU-18938, skip 360 00010000:00010000:3.0:1788925273.216974:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925274.177373:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788925274.177406:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911024256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925274.177491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925274.177689:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911024256 00000100:00100000:0.0:1788925274.177697:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911024256 00000100:00100000:0.0:1788925274.177776:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788925274.177788:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911024256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925274.177820:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925274.177864:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911024256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925274.177872:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788925274.177907:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d4192e300 x1875823911024256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925274.177925:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911024256:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788925274.178277:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788925274.249815:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925275.201412:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911024512:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.201467:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911024640:0@lo:400:kworker.0 00000100:00100000:1.0:1788925275.201475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.201528:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911024384:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.214547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.214617:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925275.214629:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911024768:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.214671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.214713:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911024512 00000100:00100000:0.0:1788925275.214720:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911024512 00000100:00100000:0.0:1788925275.214783:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911024640 00000100:00100000:0.0:1788925275.214799:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911024640 00000100:00100000:0.0:1788925275.214851:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788925275.214861:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.214913:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911024512:12345-0@lo:400:kworker.0 Request processed in 54us (13437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.214920:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788925275.214938:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788925275.214944:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911024640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.216617:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911024640:12345-0@lo:400:kworker.0 Request processed in 1665us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.216628:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788925275.216673:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911024768 00000100:00100000:0.0:1788925275.216680:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911024768 00000100:00100000:2.0:1788925275.216701:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911024640:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.216718:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788925275.216726:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911024768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.216795:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911024768:12345-0@lo:400:kworker.0 Request processed in 57us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.216802:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788925275.216824:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788925275.217062:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ac6ed80 x1875823911024768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925275.217091:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911024768:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.219088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.219122:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911024512:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.219136:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911024896:0@lo:400:kworker.0 00000100:00100000:1.0:1788925275.219136:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911025024:0@lo:400:kworker.0 00000100:00100000:1.0:1788925275.219186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.219191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.219226:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911025024 00000100:00100000:3.0:1788925275.219229:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911024896 00000100:00100000:1.0:1788925275.219232:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911025024 00000100:00100000:3.0:1788925275.219235:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911024896 00000100:00100000:3.0:1788925275.219290:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788925275.219300:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911024896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925275.219315:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911024384 00000100:00100000:2.0:1788925275.219320:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911024384 00000100:00100000:3.0:1788925275.219343:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911024896:12345-0@lo:400:kworker.0 Request processed in 44us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.219350:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788925275.219367:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788925275.219376:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911024384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925275.219424:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911024384:12345-0@lo:400:kworker.0 Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.219430:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:3.0:1788925275.220290:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925275.220297:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925275.221345:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788925275.221357:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911025024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925275.221442:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911025024:12345-0@lo:400:kworker.0 Request processed in 89us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925275.221449:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788925275.221490:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ac6c700 x1875823911025024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925275.221504:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911025024:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.221799:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911024896:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.221957:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911024384:0@lo:400:kworker.0 00010000:00010000:1.0:1788925275.266884:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925275.488110:0:10261:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34683192 < 34486116) for LU-14927, skip 0f 00000100:00100000:3.0:1788925275.712935:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925275.712956:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911025152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925275.713021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.713090:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911025152 00000100:00100000:3.0:1788925275.713098:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911025152 00000100:00100000:3.0:1788925275.713139:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788925275.713148:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911025152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925275.713183:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925275.713226:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911025152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.713233:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788925275.713269:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dfea00 x1875823911025152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925275.713287:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911025152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925276.291852:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925277.312943:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925277.360070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925277.360115:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925277.360178:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892113408 00000100:00100000:3.0:1788925277.360189:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892113408 00000100:00100000:3.0:1788925277.360258:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00100000:3.0:1788925277.360269:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892113408:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925277.360356:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892113408:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925277.360364:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 77 00000100:00080000:1.0:1788925277.360585:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925277.361555:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892113280 00000100:00100000:2.0:1788925277.361563:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892113280 00000100:00100000:2.0:1788925277.361615:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 214 00000100:00100000:2.0:1788925277.361625:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892113280:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925277.361686:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892113280:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 63us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925277.361704:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 214 00000001:02000400:1.0:1788925277.556167:0:10309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34683192 < 34681754) for LU-12550, skip 216 00010000:00010000:1.0:1788925278.348330:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925279.300274:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925279.300309:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911025280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925279.300414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925279.300499:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911025280 00000100:00100000:3.0:1788925279.300509:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911025280 00000100:00100000:3.0:1788925279.300581:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788925279.300593:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911025280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925279.300654:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925279.300709:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911025280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925279.300716:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788925279.300758:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788925279.300804:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dfea00 x1875823911025280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925279.300828:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911025280:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788925279.365184:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788925279.765111:0:10357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 00000100:00100000:3.0:1788925280.323888:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911025792:0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.323961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925280.324034:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925280.324040:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911025664:0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.324095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925280.324131:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911025792 00000100:00100000:3.0:1788925280.324138:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911025792 00000100:00100000:3.0:1788925280.324192:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788925280.324200:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ffc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911025792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.324245:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ffc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911025792:12345-0@lo:400:kworker.0 Request processed in 46us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925280.324251:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788925280.324272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911025664 00000100:00100000:3.0:1788925280.324275:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911025664 00000100:00100000:3.0:1788925280.324304:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788925280.324310:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911025664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.324343:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911025664:12345-0@lo:400:kworker.0 Request processed in 34us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925280.324349:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788925280.324380:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925280.324406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911025664:0@lo:400:kworker.0 00010000:00080000:3.0:1788925280.324419:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dff100 x1875823911025792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925280.324430:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911025792:0@lo:400:kworker.0 00000100:00100000:1.0:1788925280.325048:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911025536:0@lo:400:kworker.0 00000100:00100000:1.0:1788925280.325099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925280.325131:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911026048:0@lo:400:kworker.0 00000100:00100000:1.0:1788925280.325390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925280.325433:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788925280.325440:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911025408:0@lo:400:kworker.0 00000100:00100000:1.0:1788925280.325468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925280.325488:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911025920:0@lo:400:kworker.0 00000100:00100000:1.0:1788925280.325520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925280.325663:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911026048 00000100:00100000:0.0:1788925280.325669:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911026048 00000100:00100000:0.0:1788925280.325707:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788925280.325708:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925280.325717:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911026048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.325795:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911026048:12345-0@lo:400:kworker.0 Request processed in 80us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925280.325801:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788925280.326139:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41dfca80 x1875823911026048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925280.327779:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911025536 00000100:00100000:3.0:1788925280.327792:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911025536 00000100:00100000:1.0:1788925280.328536:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911026048:0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.328602:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911025920 00000100:00100000:0.0:1788925280.328623:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911025920 00000100:00100000:0.0:1788925280.328694:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788925280.328707:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911025920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.328724:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788925280.328735:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911025536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.328912:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911025408 00000100:00100000:2.0:1788925280.328917:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911025408 00000100:00100000:2.0:1788925280.328948:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788925280.328955:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911025408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.328999:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911025408:12345-0@lo:400:kworker.0 Request processed in 44us (3530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925280.329001:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911025536:12345-0@lo:400:kworker.0 Request processed in 256us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925280.329014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788925280.329018:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788925280.329103:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925280.329130:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911025408:0@lo:400:kworker.0 00000100:00100000:1.0:1788925280.330334:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911025920:0@lo:400:kworker.0 00000100:00100000:1.0:1788925280.330368:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911025536:0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.331034:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911025920:12345-0@lo:400:kworker.0 Request processed in 112us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925280.331047:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:1.0:1788925280.385185:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925280.833137:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925280.834804:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911026176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925280.834872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925280.835048:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911026176 00000100:00100000:3.0:1788925280.835057:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911026176 00000100:00100000:3.0:1788925280.835112:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788925280.835122:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911026176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788925280.835157:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788925280.835211:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911026176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925280.835218:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788925280.835409:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d40eb8380 x1875823911026176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925280.835429:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911026176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925281.409057:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788925282.137810:0:10405:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 00010000:00010000:2.0:1788925282.434821:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925282.470385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925282.470442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925282.470638:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892113664 00000100:00100000:3.0:1788925282.470649:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892113664 00000100:00100000:3.0:1788925282.470807:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:3.0:1788925282.470830:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892113664:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925282.470913:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892113664:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 86us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925282.470921:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 81 00000100:00100000:0.0:1788925282.471096:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892113536 00000100:00100000:0.0:1788925282.471101:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892113536 00000100:00100000:0.0:1788925282.471137:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00100000:0.0:1788925282.471145:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892113536:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925282.471179:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892113536:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925282.471185:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 216 00000100:00080000:1.0:1788925282.472376:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925283.457087:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788925284.079708:0:10454:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 23:41:22 (1788925282) === 00000100:00100000:0.0:1788925284.419053:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925284.419082:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d4192f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911026304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925284.419158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925284.419219:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911026304 00000100:00100000:0.0:1788925284.419226:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911026304 00000100:00100000:0.0:1788925284.419277:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788925284.419286:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911026304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925284.419318:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925284.419371:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911026304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925284.419378:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788925284.419397:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788925284.419425:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d4192f800 x1875823911026304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925284.419458:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d4192f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911026304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788925284.481267:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925285.445352:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911026560:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.445418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.445465:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911027072:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.445487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.445512:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788925285.445516:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911026432:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.445548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.445581:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911026944:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.445599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.445621:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911026816:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.445640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.445658:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925285.445663:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911026688:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.445684:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.445712:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911026432 00000100:00100000:1.0:1788925285.445718:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911026432 00000100:00100000:1.0:1788925285.445778:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788925285.445788:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911026432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.445832:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911026432:12345-0@lo:400:kworker.0 Request processed in 45us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.445840:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788925285.445882:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911026432:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.446369:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911026560 00000100:00100000:3.0:1788925285.446374:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911026560 00000100:00100000:3.0:1788925285.446407:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911026944 00000100:00100000:3.0:1788925285.446410:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911026944 00000100:00100000:3.0:1788925285.446431:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911026688 00000100:00100000:3.0:1788925285.446433:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911026688 00000100:00100000:3.0:1788925285.446445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788925285.446451:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911026560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.446493:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911026560:12345-0@lo:400:kworker.0 Request processed in 42us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925285.446499:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788925285.446510:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788925285.446515:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911026944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.446536:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911026944:12345-0@lo:400:kworker.0 Request processed in 22us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925285.446541:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788925285.446549:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788925285.446554:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911026688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.446579:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911026688:12345-0@lo:400:kworker.0 Request processed in 25us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925285.446585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788925285.446609:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911027072 00000100:00100000:3.0:1788925285.446612:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911027072 00000100:00100000:3.0:1788925285.446633:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911026816 00000100:00100000:3.0:1788925285.446635:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911026816 00000100:00100000:3.0:1788925285.446645:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788925285.446651:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911027072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.446680:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911027072:12345-0@lo:400:kworker.0 Request processed in 29us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925285.446686:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788925285.446697:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788925285.446702:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911026816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.446730:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911026816:12345-0@lo:400:kworker.0 Request processed in 27us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925285.446735:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788925285.446773:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925285.446777:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925285.446801:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911026688:0@lo:400:kworker.0 00010000:00080000:3.0:1788925285.446814:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d066b3800 x1875823911026816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925285.446824:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911026816:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.446851:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911026944:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.446861:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911026560:0@lo:400:kworker.0 00010000:00080000:3.0:1788925285.446870:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41b58700 x1875823911027072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925285.446877:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911027072:0@lo:400:kworker.0 00010000:00010000:1.0:1788925285.507360:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925285.952958:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925285.952979:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911027200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925285.953041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.953113:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911027200 00000100:00100000:1.0:1788925285.953120:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911027200 00000100:00100000:1.0:1788925285.953166:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788925285.953176:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911027200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925285.953209:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925285.953250:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911027200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.953264:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788925285.953302:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41b58000 x1875823911027200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925285.953320:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911027200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788925286.529574:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925287.553100:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925287.607827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925287.608081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925287.608133:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892113920 00000100:00100000:1.0:1788925287.608144:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892113920 00000100:00100000:1.0:1788925287.608217:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00100000:1.0:1788925287.608230:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892113920:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925287.608333:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892113920:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925287.608341:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 85 00000100:00080000:1.0:1788925287.608367:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925287.609573:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892113792 00000100:00100000:0.0:1788925287.609584:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892113792 00000100:00100000:0.0:1788925287.609641:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 218 00000100:00100000:0.0:1788925287.609651:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892113792:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925287.609729:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892113792:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 80us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.609736:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 218 00010000:00010000:2.0:1788925288.579109:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925289.539833:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911027328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925289.539927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925289.540728:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911027328 00000100:00100000:1.0:1788925289.540739:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911027328 00000100:00100000:1.0:1788925289.540828:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788925289.540840:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911027328:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788925289.540849:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788925289.540887:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925289.540971:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911027328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925289.540978:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788925289.541069:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d40eb9880 x1875823911027328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925289.541094:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911027328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788925289.601273:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925290.301737:0:10647:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788925290.563167:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911027456:0@lo:400:kworker.0 00000100:00100000:3.0:1788925290.563353:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911027840:0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.563410:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911027584:0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.563588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925290.563697:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911027968:0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.563730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925290.563785:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911027712:0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.563834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925290.563877:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911027968 00000100:00100000:2.0:1788925290.563885:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911027968 00000100:00100000:2.0:1788925290.563942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911027712 00000100:00100000:2.0:1788925290.563945:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911027712 00000100:00100000:2.0:1788925290.563968:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788925290.563979:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911027968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.564035:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911027968:12345-0@lo:400:kworker.0 Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925290.564041:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788925290.564059:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788925290.564065:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911027712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.564105:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911027712:12345-0@lo:400:kworker.0 Request processed in 40us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925290.564112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788925290.564129:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925290.564516:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911027712:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.564612:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911027456 00000100:00100000:1.0:1788925290.564625:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911027456 00000100:00100000:1.0:1788925290.564658:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788925290.564665:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911027456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925290.564684:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925290.564709:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911027456:12345-0@lo:400:kworker.0 Request processed in 45us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.564715:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788925290.564728:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911027840 00000100:00100000:3.0:1788925290.564732:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911027840 00000100:00100000:3.0:1788925290.564777:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788925290.564781:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788925290.564784:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911027840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.564788:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788925290.564822:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911027840:12345-0@lo:400:kworker.0 Request processed in 39us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925290.564828:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788925290.564994:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911027968:0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.565003:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911027456:0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.565674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925290.565713:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911028096:0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.565993:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911027584 00000100:00100000:2.0:1788925290.565999:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911027584 00000100:00100000:0.0:1788925290.566094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925290.566131:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911028096 00000100:00100000:0.0:1788925290.566135:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911028096 00000100:00100000:0.0:1788925290.566187:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788925290.566195:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d084a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911028096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.566251:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d084a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911028096:12345-0@lo:400:kworker.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925290.566257:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788925290.566421:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788925290.566443:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41b58e00 x1875823911028096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925290.566474:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911028096:0@lo:400:kworker.0 00010000:00080000:3.0:1788925290.566643:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41b58a80 x1875823911027840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925290.566654:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911027840:0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.566773:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788925290.566782:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911027584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.566827:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911027584:12345-0@lo:400:kworker.0 Request processed in 47us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925290.566833:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788925290.566899:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911027584:0@lo:400:kworker.0 00010000:00010000:2.0:1788925290.624911:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925291.073039:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925291.073065:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911028224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925291.073134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925291.073259:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911028224 00000100:00100000:1.0:1788925291.073278:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911028224 00000100:00100000:1.0:1788925291.073353:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788925291.073363:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911028224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925291.073400:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925291.073457:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911028224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925291.073463:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788925291.073623:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41b5b800 x1875823911028224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925291.073641:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911028224:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925291.648936:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925292.674669:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925292.721766:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925292.721809:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925292.721852:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892114176 00000100:00100000:1.0:1788925292.721861:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892114176 00000100:00100000:1.0:1788925292.721935:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00100000:1.0:1788925292.721946:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892114176:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925292.722032:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892114176:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925292.722040:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 89 00000100:00080000:1.0:1788925292.722061:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925292.724804:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892114048 00000100:00100000:2.0:1788925292.724818:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892114048 00000100:00100000:2.0:1788925292.724903:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 220 00000100:00100000:2.0:1788925292.724914:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892114048:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925292.725001:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892114048:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 89us (3259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925292.725009:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 220 00010000:00010000:3.0:1788925293.696923:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925294.665325:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925294.665364:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911028352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925294.665430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925294.665491:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911028352 00000100:00100000:1.0:1788925294.665497:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911028352 00000100:00100000:1.0:1788925294.665557:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788925294.665565:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911028352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925294.665594:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925294.665630:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911028352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925294.665636:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788925294.665654:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788925294.665679:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41b5ad80 x1875823911028352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925294.665695:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911028352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788925294.721069:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925295.681501:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911028736:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.681717:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911028480:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.681772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925295.681927:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911028864:0@lo:400:kworker.0 00000100:00100000:1.0:1788925295.682863:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911028608:0@lo:400:kworker.0 00000100:00100000:1.0:1788925295.683164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925295.683202:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911029120:0@lo:400:kworker.0 00000100:00100000:1.0:1788925295.683230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925295.683335:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911028736 00000100:00100000:1.0:1788925295.683342:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911028736 00000100:00100000:1.0:1788925295.683411:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911028608 00000100:00100000:1.0:1788925295.683415:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911028608 00000100:00100000:1.0:1788925295.683468:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788925295.683478:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911028736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925295.685097:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911028736:12345-0@lo:400:kworker.0 Request processed in 1612us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925295.685119:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788925295.685147:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788925295.685156:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911028608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925295.685209:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911028608:12345-0@lo:400:kworker.0 Request processed in 56us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925295.685214:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788925295.685236:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911029120 00000100:00100000:1.0:1788925295.685242:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911029120 00000100:00100000:1.0:1788925295.685299:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788925295.685304:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911029120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925295.685355:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911029120:12345-0@lo:400:kworker.0 Request processed in 51us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925295.685360:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788925295.685374:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925295.685378:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925295.685417:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911028736:0@lo:400:kworker.0 00000100:00100000:1.0:1788925295.685465:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911028608:0@lo:400:kworker.0 00010000:00080000:1.0:1788925295.685478:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d40eba300 x1875823911029120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925295.685498:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911029120:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.691098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925295.691166:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911028992:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.691220:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925295.691250:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911028992 00000100:00100000:0.0:1788925295.691257:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911028992 00000100:00100000:3.0:1788925295.691305:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911028480 00000100:00100000:3.0:1788925295.691309:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911028480 00000100:00100000:0.0:1788925295.691328:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788925295.691337:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911028992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.691341:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788925295.691347:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911028480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.691384:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911028480:12345-0@lo:400:kworker.0 Request processed in 37us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.691384:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911028992:12345-0@lo:400:kworker.0 Request processed in 47us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925295.691391:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788925295.691391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1788925295.691416:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925295.691446:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911028992:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.691470:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911028480:0@lo:400:kworker.0 00000100:00100000:2.0:1788925295.693399:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925295.693516:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911028864 00000100:00100000:0.0:1788925295.693523:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911028864 00000100:00100000:0.0:1788925295.693615:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788925295.693626:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911028864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.693778:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911028864:12345-0@lo:400:kworker.0 Request processed in 154us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.693794:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788925295.695902:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d40eb9500 x1875823911028864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925295.695921:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911028864:0@lo:400:kworker.0 00010000:00010000:1.0:1788925295.751114:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925296.193058:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925296.193083:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911029248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925296.193168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925296.193294:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911029248 00000100:00100000:1.0:1788925296.193302:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911029248 00000100:00100000:1.0:1788925296.193354:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788925296.193363:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911029248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925296.193398:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925296.193459:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911029248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925296.193467:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788925296.193548:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41b5bb80 x1875823911029248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925296.193569:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911029248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925296.770011:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925297.794683:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925297.834528:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925297.834571:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925297.834726:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892114304 00000100:00100000:0.0:1788925297.834737:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892114304 00000100:00100000:0.0:1788925297.834808:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:0.0:1788925297.834819:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892114304:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925297.834899:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892114304:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925297.834907:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 222 00000100:00100000:0.0:1788925297.835814:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892114432 00000100:00100000:0.0:1788925297.835823:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892114432 00000100:00080000:3.0:1788925297.835875:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925297.835883:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 93 00000100:00100000:0.0:1788925297.835893:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892114432:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925297.835956:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40ebb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892114432:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 64us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925297.835962:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 93 00010000:00010000:0.0:1788925298.823761:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925299.784309:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911029376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925299.784402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925299.784501:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911029376 00000100:00100000:0.0:1788925299.784510:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911029376 00000100:00100000:0.0:1788925299.784584:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788925299.784594:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911029376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925299.784627:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788925299.791794:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925299.793430:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911029376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8829us (9020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925299.793445:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788925299.796711:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d07eb3800 x1875823911029376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925299.796736:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911029376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788925299.840875:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925300.801289:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911029632:0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.801384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925300.801450:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911030144:0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.801479:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925300.801512:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788925300.801530:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.801559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925300.801584:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911030016:0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.801606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925300.801634:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911029888:0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.801669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925300.801690:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925300.801696:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911029760:0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.801717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925300.801773:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911030144 00000100:00100000:1.0:1788925300.801780:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911030144 00000100:00100000:1.0:1788925300.802016:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911029888 00000100:00100000:1.0:1788925300.802020:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911029888 00000100:00100000:1.0:1788925300.802049:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788925300.802058:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911030144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.802250:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911030144:12345-0@lo:400:kworker.0 Request processed in 192us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.802258:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788925300.802277:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788925300.802283:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911029888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.802318:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911029888:12345-0@lo:400:kworker.0 Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.802324:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788925300.802342:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911029504 00000100:00100000:1.0:1788925300.802345:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911029504 00000100:00100000:1.0:1788925300.802401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788925300.802408:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911029504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.802440:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911029504:12345-0@lo:400:kworker.0 Request processed in 33us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.802446:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788925300.802471:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911029632 00000100:00100000:1.0:1788925300.802476:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911029632 00000100:00100000:1.0:1788925300.802507:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911030016 00000100:00100000:1.0:1788925300.802523:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911030016 00000100:00100000:1.0:1788925300.802545:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911029760 00000100:00100000:1.0:1788925300.802549:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911029760 00000100:00100000:1.0:1788925300.802563:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788925300.802568:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911029632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.802602:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911029632:12345-0@lo:400:kworker.0 Request processed in 33us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.802608:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788925300.802620:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788925300.802626:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911030016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.802654:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911030016:12345-0@lo:400:kworker.0 Request processed in 28us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.802660:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788925300.802669:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788925300.802675:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911029760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.802699:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911029760:12345-0@lo:400:kworker.0 Request processed in 25us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.802705:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788925300.802727:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925300.802731:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788925300.803284:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911029760:0@lo:400:kworker.0 00010000:00080000:1.0:1788925300.803305:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d40eb8700 x1875823911029888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925300.803317:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911029888:0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.803353:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.803379:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911030016:0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.803390:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40ebad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911029632:0@lo:400:kworker.0 00010000:00080000:1.0:1788925300.803401:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d40ebaa00 x1875823911030144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925300.803410:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40ebaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911030144:0@lo:400:kworker.0 00010000:00010000:0.0:1788925300.866068:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925301.313218:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925301.313270:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d41b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911030272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925301.313350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925301.313566:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911030272 00000100:00100000:0.0:1788925301.313586:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911030272 00000100:00100000:0.0:1788925301.313656:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788925301.313667:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911030272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788925301.313721:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925301.313969:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40ebaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911030272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 303us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925301.313977:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788925301.314162:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d41b59500 x1875823911030272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925301.314179:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d41b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911030272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788925301.893018:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925302.912933:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925302.951375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925302.952005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925302.952102:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892114688 00000100:00100000:2.0:1788925302.952117:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892114688 00000100:00080000:3.0:1788925302.952216:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925302.952246:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:2.0:1788925302.952261:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892114688:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925302.952366:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40ebad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892114688:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 109us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925302.952376:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 97 00000100:00100000:0.0:1788925302.952723:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892114560 00000100:00100000:0.0:1788925302.952730:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892114560 00000100:00100000:0.0:1788925302.952787:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 224 00000100:00100000:0.0:1788925302.952796:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892114560:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925302.952846:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892114560:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925302.952853:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 224 00010000:00010000:1.0:1788925303.941064:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925304.897261:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911030400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925304.897334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925304.897470:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911030400 00000100:00100000:2.0:1788925304.897479:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911030400 00000100:00100000:2.0:1788925304.897641:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788925304.897653:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911030400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925304.897686:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1788925304.897792:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d07eb1f80 x1875823911030400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925304.897797:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911030400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925304.897812:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788925304.897824:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911030400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788925304.900294:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788925304.960956:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925305.921957:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911030656:0@lo:400:kworker.0 00000100:00100000:1.0:1788925305.922028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925305.922073:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911030784:0@lo:400:kworker.0 00000100:00100000:1.0:1788925305.922101:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911031168:0@lo:400:kworker.0 00000100:00100000:3.0:1788925305.922102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925305.922161:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911030528:0@lo:400:kworker.0 00000100:00100000:2.0:1788925305.922601:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911030656 00000100:00100000:2.0:1788925305.922608:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911030656 00000100:00100000:2.0:1788925305.922650:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911030784 00000100:00100000:2.0:1788925305.922654:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911030784 00000100:00100000:2.0:1788925305.922682:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788925305.922690:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911030656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925305.926371:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925305.926394:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911030912:0@lo:400:kworker.0 00000100:00100000:0.0:1788925305.926685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925305.926716:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911031040:0@lo:400:kworker.0 00000100:00100000:0.0:1788925305.926757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925305.926943:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788925305.926948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925305.926958:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911030784:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788925305.926999:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925305.927010:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911030784:12345-0@lo:400:kworker.0 Request processed in 58us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925305.927012:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911030528 00000100:00100000:3.0:1788925305.927018:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788925305.927020:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911030528 00000100:00100000:2.0:1788925305.927100:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911030656:12345-0@lo:400:kworker.0 Request processed in 4410us (5071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925305.927101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788925305.927107:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788925305.927122:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911030528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925305.927160:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911030528:12345-0@lo:400:kworker.0 Request processed in 53us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925305.927167:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788925305.927198:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911031168 00000100:00100000:1.0:1788925305.927219:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911031168 00000100:00100000:1.0:1788925305.927263:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788925305.927269:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911031168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925305.927301:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911031168:12345-0@lo:400:kworker.0 Request processed in 32us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925305.927307:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788925305.927325:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788925305.927339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925305.927374:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911030784:0@lo:400:kworker.0 00000100:00100000:1.0:1788925305.927400:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911030912 00000100:00100000:1.0:1788925305.927404:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911030912 00000100:00100000:1.0:1788925305.927425:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788925305.927431:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911030912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925305.927478:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911030912:12345-0@lo:400:kworker.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925305.927494:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788925305.927523:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d07eb1c00 x1875823911030912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925305.927536:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911030912:0@lo:400:kworker.0 00010000:00080000:1.0:1788925305.927559:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d07eb3100 x1875823911031168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925305.927568:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911031168:0@lo:400:kworker.0 00000100:00100000:1.0:1788925305.927579:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911030656:0@lo:400:kworker.0 00000100:00100000:0.0:1788925305.927734:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911030528:0@lo:400:kworker.0 00000100:00100000:3.0:1788925305.928988:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911031040 00000100:00100000:3.0:1788925305.928999:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911031040 00000100:00100000:3.0:1788925305.929093:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788925305.929102:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911031040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925305.929187:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911031040:12345-0@lo:400:kworker.0 Request processed in 86us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925305.929193:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788925305.929248:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911031040:0@lo:400:kworker.0 00000100:00080000:1.0:1788925305.930068:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925305.985002:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925306.443959:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925306.443986:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911031296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925306.444056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925306.444124:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911031296 00000100:00100000:1.0:1788925306.444132:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911031296 00000100:00100000:1.0:1788925306.444176:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788925306.444185:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911031296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925306.444232:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925306.444275:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911031296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925306.444283:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788925306.444321:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ac6d880 x1875823911031296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925306.444339:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911031296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788925307.011907:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925308.035931:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925308.073526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925308.073574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925308.073663:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892114944 00000100:00100000:0.0:1788925308.073672:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892114944 00000100:00100000:0.0:1788925308.073773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00100000:0.0:1788925308.073786:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892114944:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925308.073865:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892114944:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 82us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925308.073872:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 101 00000100:00080000:1.0:1788925308.074067:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925308.074426:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892114816 00000100:00100000:3.0:1788925308.074431:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892114816 00000100:00100000:3.0:1788925308.074470:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 226 00000100:00100000:3.0:1788925308.074478:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892114816:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925308.074521:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892114816:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 43us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925308.074528:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 226 00000001:02000400:0.0:1788925308.571781:0:11346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788925309.057012:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925310.020820:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925310.020845:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911031424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925310.020984:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925310.021084:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911031424 00000100:00100000:2.0:1788925310.021092:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911031424 00000100:00100000:2.0:1788925310.021154:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788925310.021164:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911031424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925310.021223:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925310.021271:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911031424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925310.021279:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788925310.022015:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788925310.022053:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d07eb1880 x1875823911031424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925310.022074:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911031424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788925310.086143:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925311.042482:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911031808:0@lo:400:kworker.0 00000100:00100000:3.0:1788925311.042544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925311.042596:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925311.042601:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911031936:0@lo:400:kworker.0 00000100:00100000:3.0:1788925311.042625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925311.042675:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911031808 00000100:00100000:3.0:1788925311.042682:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911031808 00000100:00100000:3.0:1788925311.042731:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788925311.042762:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911031808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925311.042826:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911031808:12345-0@lo:400:kworker.0 Request processed in 87us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925311.042833:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788925311.042858:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911031936 00000100:00100000:3.0:1788925311.042862:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911031936 00000100:00100000:0.0:1788925311.042970:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911031552:0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925311.043024:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911032064:0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925311.043061:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788925311.043067:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911031680:0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925311.043100:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911032192:0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925311.043143:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911031552 00000100:00100000:0.0:1788925311.043153:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911031552 00000100:00100000:0.0:1788925311.043190:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788925311.043196:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911031552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043241:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911031552:12345-0@lo:400:kworker.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925311.043248:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788925311.043273:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911032064 00000100:00100000:0.0:1788925311.043276:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911032064 00000100:00100000:0.0:1788925311.043297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911031680 00000100:00100000:0.0:1788925311.043301:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911031680 00000100:00100000:0.0:1788925311.043315:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788925311.043320:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911032064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043348:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911032064:12345-0@lo:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925311.043353:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788925311.043363:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788925311.043368:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d4192f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911031680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043391:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d4192f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911031680:12345-0@lo:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925311.043396:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788925311.043411:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911032192 00000100:00100000:0.0:1788925311.043414:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911032192 00000100:00100000:0.0:1788925311.043439:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788925311.043445:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911032192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043474:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911032192:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925311.043480:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788925311.043527:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911031680:0@lo:400:kworker.0 00010000:00080000:0.0:1788925311.043540:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d40eb8a80 x1875823911032192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925311.043551:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911032192:0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043559:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911031552:0@lo:400:kworker.0 00000100:00100000:0.0:1788925311.043566:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911032064:0@lo:400:kworker.0 00000100:00080000:0.0:1788925311.043608:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788925311.043613:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925311.043630:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911031808:0@lo:400:kworker.0 00000100:00100000:3.0:1788925311.043866:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788925311.043942:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911031936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925311.043982:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911031936:12345-0@lo:400:kworker.0 Request processed in 43us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925311.043988:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788925311.044514:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d40eb9500 x1875823911031936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925311.044527:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911031936:0@lo:400:kworker.0 00010000:00010000:3.0:1788925311.107801:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925311.554550:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911032320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925311.554630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925311.554698:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911032320 00000100:00100000:2.0:1788925311.554705:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911032320 00000100:00100000:2.0:1788925311.555425:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788925311.555435:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911032320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925311.555471:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925311.555540:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911032320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925311.555547:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788925311.555614:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d07eb0000 x1875823911032320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925311.555645:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911032320:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788925311.834340:0:11494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff45ab3dd0 20000000:00000080:0.0:1788925311.834362:0:11494:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e0d35456000 uarg=0000000000000000 20000000:01000000:0.0:1788925311.834399:0:11494:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788925311.834404:0:11494:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788925311.834410:0:11494:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788925311.839921:0:11495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788925311.843267:0:11494:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788925311.864703:0:11494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788925311.864926:0:11494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.864952:0:11494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd7e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.864961:0:11494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29151a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.864967:0:11494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291528 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.864973:0:11494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291536 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.864995:0:11494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.865036:0:11494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a291536 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.865052:0:11494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a291536 expref: 18 pid: 5832 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925311.865066:0:11494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11494:1875823911032448:0@lo:104: 00000100:00100000:2.0:1788925311.865128:0:11494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925311.865202:0:11494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a291528 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.865210:0:11494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a291528 expref: 18 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925311.865218:0:11494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11494:1875823911032576:0@lo:104: 00000100:00100000:2.0:1788925311.865239:0:11494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925311.865261:0:11494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb29fc47e1a29151a expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.865268:0:11494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb29fc47e1a29151a expref: 18 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925311.865276:0:11494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11494:1875823911032704:0@lo:104: 00000100:00100000:2.0:1788925311.865293:0:11494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925311.865309:0:11494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd7e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.865330:0:11494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd7e expref: 9 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925311.865341:0:11494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11494:1875823911032832:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788925311.865493:0:11494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d118eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925311.866243:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911032448 00000100:00100000:0.0:1788925311.866252:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911032448 00000100:00100000:0.0:1788925311.866460:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911032576 00000100:00100000:0.0:1788925311.866464:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911032576 00000100:00100000:0.0:1788925311.866476:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911032704 00000100:00100000:0.0:1788925311.866479:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911032704 00000100:00100000:0.0:1788925311.866492:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788925311.866501:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+5:11494:x1875823911032448:12345-0@lo:104: 00010000:00010000:0.0:1788925311.866513:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866605:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925311.866612:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+5:11494:x1875823911032448:12345-0@lo:104: Request processed in 113us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925311.866619:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788925311.866634:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788925311.866640:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+4:11494:x1875823911032576:12345-0@lo:104: 00000100:00100000:3.0:1788925311.866641:0:11494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11494:1875823911032448:0@lo:104: 00010000:00010000:0.0:1788925311.866648:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866690:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788925311.866696:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+4:11494:x1875823911032576:12345-0@lo:104: Request processed in 57us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925311.866701:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788925311.866713:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925311.866719:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+3:11494:x1875823911032704:12345-0@lo:104: 00010000:00010000:0.0:1788925311.866725:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866777:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788925311.866782:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:76f68b46-a017-4297-a662-44212e04e46d+3:11494:x1875823911032704:12345-0@lo:104: Request processed in 63us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925311.866788:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788925311.866804:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788925311.866809:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866826:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8d200 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925311.866831:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866839:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925311.866846:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925311.866852:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788925311.866881:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866887:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925311.866906:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866912:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8d200/0xb29fc47e1a291536 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29153d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866923:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788925311.866926:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866932:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148a800 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925311.866934:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866951:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925311.866958:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925311.866960:0:11494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11494:1875823911032576:0@lo:104: 10000000:01000000:0.0:1788925311.866964:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788925311.866970:0:11494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11494:1875823911032704:0@lo:104: 00010000:00010000:0.0:1788925311.866977:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.866983:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925311.867006:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.867013:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a800/0xb29fc47e1a291528 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a29152f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.867024:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925311.867027:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.867033:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00030c00 already unused, calling callback (ffffffffc1a3cc20) 10000000:00010000:0.0:1788925311.867036:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.867043:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925311.867049:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925311.867061:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788925311.867074:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.867080:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925311.867087:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.867093:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.104@tcp lock: ffff9e0d00030c00/0xb29fc47e1a29151a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb29fc47e1a291521 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925311.867099:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911033088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925311.867106:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925311.867107:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925311.867109:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925311.867114:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925311.867129:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823911032960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925311.867133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925311.867153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925311.867198:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911033088 00000100:00100000:0.0:1788925311.867201:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911033088 00010000:00010000:0.0:1788925311.867229:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291528 expref: 19 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925311.867246:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911032960 00000100:00100000:0.0:1788925311.867248:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911032960 00010000:00010000:0.0:1788925311.867257:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291536 expref: 20 pid: 5832 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925311.867270:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788925311.867275:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d085fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+20:3304:x1875823911033088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925311.867292:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925311.867297:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291528 expref: 20 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.867306:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a291528 expref: 20 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925311.867309:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925311.867316:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911033216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925311.867318:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d00031800/0xb29fc47e1a29152f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a291528 expref: 20 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925311.867331:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925311.867344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925311.867350:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d085fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911033088:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925311.867357:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788925311.867360:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911033088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925311.867835:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911033216 00000100:00100000:1.0:1788925311.867842:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911033216 00010000:00010000:1.0:1788925311.867863:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29151a expref: 19 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925311.867884:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925311.867891:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+19:3307:x1875823911032960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788925311.867914:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925311.867919:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a291536 expref: 19 pid: 5832 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925311.867930:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a291536 expref: 19 pid: 5832 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925311.867941:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07ed9400/0xb29fc47e1a29153d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a291536 expref: 19 pid: 5832 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925311.867950:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925311.867992:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+18:3307:x1875823911032960:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925311.867999:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925311.868013:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788925311.868019:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+17:3304:x1875823911033216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788925311.868027:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925311.868031:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb29fc47e1a29151a expref: 17 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925311.868041:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb29fc47e1a29151a expref: 17 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925311.868051:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07d8dc00/0xb29fc47e1a291521 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb29fc47e1a29151a expref: 17 pid: 5833 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925311.868059:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925311.868090:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f68b46-a017-4297-a662-44212e04e46d+16:3304:x1875823911033216:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925311.868121:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788925311.868157:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911033216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925311.868676:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823911032960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925311.869740:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925311.869859:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892115072 00000100:00100000:3.0:1788925311.869867:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892115072 00000100:00100000:2.0:1788925311.869888:0:11494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11494:1875823911032832:192.168.203.4@tcp:104: 00010000:00010000:3.0:1788925311.869894:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd7e expref: 10 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.869918:0:11494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925311.869926:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:3.0:1788925311.869934:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2382:x1875823892115072:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925311.869946:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925311.869952:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd7e expref: 10 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.869963:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd7e expref: 10 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.869978:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291513 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd7e expref: 10 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.869994:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.870002:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.870017:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.870024:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.870042:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.870049:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.870054:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9600 already unused, calling callback (ffffffffc141f230) 00010000:00010000:3.0:1788925311.870058:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.870065:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.871044:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925311.871062:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925311.872321:0:11494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.872335:0:11494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925311.872342:0:11494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e0d07ed9600/0xb29fc47e1a291544 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925311.873415:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:2382:x1875823892115072:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 3472us (3672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925311.873431:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00010000:00010000:0.0:1788925312.129018:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925313.152966:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925313.196947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925313.196999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925313.197041:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892115328 00000100:00100000:3.0:1788925313.197054:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892115328 00000100:00100000:3.0:1788925313.197142:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00100000:3.0:1788925313.197167:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892115328:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925313.197272:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892115328:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 119us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925313.197303:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 105 00000100:00080000:3.0:1788925313.197331:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925313.197417:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892115200 00000100:00100000:0.0:1788925313.197422:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892115200 00000100:00100000:0.0:1788925313.197465:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 228 00000100:00100000:0.0:1788925313.197474:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:2385:x1875823892115200:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925313.197507:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:2385:x1875823892115200:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925313.197515:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 228 10000000:01000000:1.0:1788925313.347089:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788925313.347100:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d0b757000 from 7 10000000:01000000:1.0:1788925313.347106:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925313.347181:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a200/0xb29fc47e1a29154b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925313.347195:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a200/0xb29fc47e1a29154b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925313.347210:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a200/0xb29fc47e1a29154b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925313.347242:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925313.347350:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925313.347410:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f845840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925313.349382:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911033344 00000100:00100000:0.0:1788925313.349398:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911033344 00000100:00100000:0.0:1788925313.349474:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788925313.349488:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+16:5836:x1875823911033344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925313.349523:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925313.349546:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a29154b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.349580:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a29154b expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.349592:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d00030400/0xb29fc47e1a291552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a29154b expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.349604:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00030400, rc 0) 00000100:00100000:0.0:1788925313.349686:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911033344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925313.349694:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788925313.350122:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925313.350145:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a200/0xb29fc47e1a29154b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925313.350163:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a200/0xb29fc47e1a29154b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925313.350249:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925313.350314:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925313.350365:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f845840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925313.350739:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911033472 00000100:00100000:0.0:1788925313.350793:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911033472 00000100:00100000:0.0:1788925313.350827:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788925313.350836:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911033472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925313.351155:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911033472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925313.351173:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788925313.351691:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925313.351781:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925313.351828:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925313.351865:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d3f845840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925313.353375:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911033600 00000100:00100000:0.0:1788925313.353388:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911033600 00000100:00100000:0.0:1788925313.353450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788925313.353459:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911033600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925313.353872:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911033600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 412us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925313.353891:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788925313.355191:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788925313.360615:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788925313.360860:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788925313.360892:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788925313.360908:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a200/0xb29fc47e1a29154b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925313.360921:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d0148a200/0xb29fc47e1a29154b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291552 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925313.360933:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788925313.360936:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d04b8b800 from 7 10000000:01000000:3.0:1788925313.360939:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788925313.360988:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8da00/0xb29fc47e1a291559 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925313.360997:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8da00/0xb29fc47e1a291559 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925313.361009:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8da00/0xb29fc47e1a291559 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925313.361041:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788925313.361130:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925313.361197:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10c3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925313.361281:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911033728 00000100:00100000:1.0:1788925313.361292:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911033728 00000100:00100000:1.0:1788925313.361357:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788925313.361369:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+17:5836:x1875823911033728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925313.361385:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925313.361400:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d0148b000/0xb29fc47e1a291560 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291559 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925313.361427:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d0148b000/0xb29fc47e1a291560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291559 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925313.361438:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d0148b000/0xb29fc47e1a291560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291559 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925313.361449:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148b000, rc 0) 00000100:00100000:1.0:1788925313.361498:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911033728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925313.361505:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788925313.362405:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925313.362426:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8da00/0xb29fc47e1a291559 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925313.362449:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8da00/0xb29fc47e1a291559 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a291560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925313.362521:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925313.362563:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925313.362589:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10c3b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925313.363343:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911033856 00000100:00100000:1.0:1788925313.363352:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911033856 00000100:00100000:1.0:1788925313.363416:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788925313.363427:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911033856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925313.363831:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911033856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 405us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925313.363839:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788925313.364115:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925313.364174:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d40eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925313.364224:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925313.364269:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d10c3b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925313.365408:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911033984 00000100:00100000:0.0:1788925313.365419:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911033984 00000100:00100000:0.0:1788925313.365476:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788925313.365488:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911033984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925313.367086:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911033984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1591us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925313.367103:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788925313.367278:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d40eb9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911033984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788925313.369528:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788925313.369650:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788925313.369671:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925313.369684:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8da00/0xb29fc47e1a291559 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.369696:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d07d8da00/0xb29fc47e1a291559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a291560 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925313.369708:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788925313.369711:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e0d1882f800 from 7 10000000:01000000:0.0:1788925313.369714:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788925313.369784:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030600/0xb29fc47e1a291567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.369796:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.104@tcp lock: ffff9e0d00030600/0xb29fc47e1a291567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.369807:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.104@tcp lock: ffff9e0d00030600/0xb29fc47e1a291567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925313.369847:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911034112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788925313.369910:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925313.369952:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1851b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925313.370356:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911034112 00000100:00100000:3.0:1788925313.370370:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911034112 00000100:00100000:3.0:1788925313.370502:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788925313.370515:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+18:5836:x1875823911034112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925313.370535:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925313.370555:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a29156e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb29fc47e1a291567 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925313.370587:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a29156e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb29fc47e1a291567 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925313.370599:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d07d8cc00/0xb29fc47e1a29156e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb29fc47e1a291567 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925313.370608:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8cc00, rc 0) 00000100:00100000:3.0:1788925313.370701:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911034112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925313.370735:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788925313.370782:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911034112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925313.370810:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.104@tcp lock: ffff9e0d00030600/0xb29fc47e1a291567 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29156e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925313.370822:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.104@tcp lock: ffff9e0d00030600/0xb29fc47e1a291567 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb29fc47e1a29156e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925313.370905:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911034240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925313.370950:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925313.375026:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d118eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788925313.380585:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911034240 00000100:00100000:0.0:1788925313.380601:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911034240 00000100:00100000:0.0:1788925313.380674:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788925313.380686:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911034240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925313.381095:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911034240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 411us (10146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925313.381105:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788925313.381636:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911034240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925313.381912:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911034368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925313.382039:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925313.382084:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1e082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788925313.382808:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911034368 00000100:00100000:0.0:1788925313.382816:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911034368 00000100:00100000:0.0:1788925313.382856:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788925313.382866:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911034368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925313.383224:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:5836:x1875823911034368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 357us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925313.383231:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788925313.383557:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:76f68b46-a017-4297-a662-44212e04e46d:5836:1875823911034368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788925313.388531:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788925313.388638:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788925313.388661:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925313.388677:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.104@tcp lock: ffff9e0d00030600/0xb29fc47e1a291567 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29156e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.388690:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.104@tcp lock: ffff9e0d00030600/0xb29fc47e1a291567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb29fc47e1a29156e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925313.831899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925313.831939:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892115456 00000100:00100000:0.0:1788925313.831952:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892115456 00000100:00100000:0.0:1788925313.832031:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:0.0:1788925313.832042:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+9:5624:x1875823892115456:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925313.832065:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925313.832088:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e0d00031000/0xb29fc47e1a291575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd85 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.832122:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e0d00031000/0xb29fc47e1a291575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd85 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.832134:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e0d00031000/0xb29fc47e1a291575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd85 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925313.832146:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00031000, rc 0) 00000100:00100000:0.0:1788925313.832232:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892115456:12345-192.168.203.4@tcp:101:ll_cfg_requeue.0 Request processed in 191us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925313.832240:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 238 00000100:00100000:0.0:1788925313.838163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925313.838399:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892115584 00000100:00100000:3.0:1788925313.838413:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892115584 00000100:00100000:3.0:1788925313.838486:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00100000:3.0:1788925313.838498:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892115584:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925313.838938:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892115584:12345-192.168.203.4@tcp:501:ll_cfg_requeue.0 Request processed in 440us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925313.838949:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 239 00000100:00100000:3.0:1788925313.841041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925313.844175:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892115712 00000100:00100000:0.0:1788925313.844194:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892115712 00000100:00100000:0.0:1788925313.844279:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 240 00000100:00100000:0.0:1788925313.844292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892115712:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788925313.844951:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:5624:x1875823892115712:12345-192.168.203.4@tcp:503:ll_cfg_requeue.0 Request processed in 657us (3917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925313.844962:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 240 00010000:00010000:0.0:1788925314.179316:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925315.137029:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925315.137055:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911034496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925315.137127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925315.137528:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911034496 00000100:00100000:1.0:1788925315.137537:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911034496 00000100:00100000:1.0:1788925315.137600:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788925315.137610:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911034496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925315.137645:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788925315.137696:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911034496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925315.137703:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788925315.137724:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788925315.137784:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3ac6ed80 x1875823911034496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925315.137803:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3ac6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911034496:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788925315.208500:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925316.163935:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823911034624:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.164007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925316.167763:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925316.167783:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911035008:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.167855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925316.167921:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911034624 00000100:00100000:3.0:1788925316.167928:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911034624 00000100:00100000:3.0:1788925316.167974:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788925316.167982:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3307:x1875823911034624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.168030:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3307:x1875823911034624:12345-0@lo:400:kworker.0 Request processed in 47us (4022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925316.168037:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788925316.168065:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911035008 00000100:00100000:3.0:1788925316.168068:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911035008 00000100:00100000:3.0:1788925316.168092:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788925316.168099:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911035008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.168137:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911035008:12345-0@lo:400:kworker.0 Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925316.168155:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788925316.168199:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3b0ffb80 x1875823911035008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925316.168213:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911035008:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.168225:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823911034624:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.169845:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911034880:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.169905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925316.169944:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925316.169951:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911034752:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.169976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925316.170013:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911034880 00000100:00100000:3.0:1788925316.170019:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911034880 00000100:00100000:3.0:1788925316.170061:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911034752 00000100:00100000:3.0:1788925316.170064:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911034752 00000100:00100000:3.0:1788925316.170086:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788925316.170094:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911034880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.170154:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911034880:12345-0@lo:400:kworker.0 Request processed in 49us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925316.170161:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788925316.170177:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788925316.170184:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911034752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.170210:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911034752:12345-0@lo:400:kworker.0 Request processed in 28us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925316.170227:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788925316.170246:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925316.170279:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911034752:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.170290:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911034880:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.172971:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823911035136:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.173036:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925316.174624:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911035136 00000100:00100000:0.0:1788925316.174636:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911035136 00000100:00100000:0.0:1788925316.174710:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788925316.174720:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823911035136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925316.179882:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823911035136:12345-0@lo:400:kworker.0 Request processed in 5153us (6836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925316.179896:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788925316.180150:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823911035136:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.180190:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911035264:0@lo:400:kworker.0 00000100:00100000:3.0:1788925316.180247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788925316.180294:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925316.180350:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911035264 00000100:00100000:0.0:1788925316.180356:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911035264 00000100:00100000:0.0:1788925316.180408:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788925316.180416:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911035264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925316.180473:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911035264:12345-0@lo:400:kworker.0 Request processed in 58us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925316.180480:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788925316.180591:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3b0fe680 x1875823911035264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925316.180602:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3b0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911035264:0@lo:400:kworker.0 00000100:00080000:3.0:1788925316.180615:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788925316.225016:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925316.675051:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925316.675072:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911035392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925316.675154:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925316.676104:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911035392 00000100:00100000:0.0:1788925316.676114:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911035392 00000100:00100000:0.0:1788925316.676193:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788925316.676204:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911035392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788925316.676241:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925316.676306:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911035392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925316.676312:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788925316.676949:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d07eb2d80 x1875823911035392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925316.676969:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911035392:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788925316.711342:0:11691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg304-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788925317.249025:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925318.276126:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925318.318217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925318.318396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925318.318436:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892115968 00000100:00100000:1.0:1788925318.318461:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892115968 00000100:00100000:1.0:1788925318.318539:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00100000:1.0:1788925318.318550:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892115968:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925318.318631:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892115968:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925318.318639:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 109 00000100:00080000:1.0:1788925318.318661:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925318.329316:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892115840 00000100:00100000:0.0:1788925318.329334:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892115840 00000100:00100000:1.0:1788925318.329661:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 242 00000100:00100000:1.0:1788925318.329672:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892115840:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:1.0:1788925318.329830:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892115840:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 160us (11622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925318.329838:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 242 00010000:00010000:1.0:1788925319.297305:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925320.258767:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925320.258788:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d07eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911035520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925320.258854:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925320.260816:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911035520 00000100:00100000:2.0:1788925320.260828:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911035520 00000100:00100000:2.0:1788925320.260897:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788925320.260907:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911035520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925320.260944:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925320.261016:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911035520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925320.261023:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788925320.261049:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788925320.261088:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d07eb1880 x1875823911035520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925320.261108:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d07eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911035520:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788925320.318091:0:11791:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 23:41:59 (1788925319) === 00010000:00010000:3.0:1788925320.320971:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925320.419059:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.419150:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892116096 00000100:00100000:0.0:1788925320.419163:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892116096 00000100:00100000:0.0:1788925320.419272:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:0.0:1788925320.419286:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3ac6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:7674:x1875823892116096:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:0.0:1788925320.419314:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788925320.420806:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788925320.422924:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a29157c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd8c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423017:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423032:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423045:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423062:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423133:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423144:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423541:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423551:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423569:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423575:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00031800 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925320.423580:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423588:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423600:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ee00) 00010000:00010000:0.0:1788925320.423603:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925320.423607:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423613:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291583 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423627:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423633:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423639:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423644:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00030c00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925320.423647:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423665:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423675:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff9e0d1297ec00) 00010000:00010000:0.0:1788925320.423677:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925320.423680:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423685:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29158a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.423723:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a29157c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd8c expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.424007:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ee00) 00010000:00010000:0.0:1788925320.424011:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788925320.424018:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a29157c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd8c expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.424030:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00031e00, rc 0) 00000100:00100000:1.0:1788925320.424301:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3ac6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:7674:x1875823892116096:12345-192.168.203.4@tcp:101:bash.0 Request processed in 5016us (5255us total) trans 0 rc 301/301 00000100:00100000:1.0:1788925320.424311:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1788925320.430676:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925320.432249:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892116224 00000100:00100000:3.0:1788925320.432376:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892116224 00000100:00100000:3.0:1788925320.432481:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788925320.432493:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:7674:x1875823892116224:12345-192.168.203.4@tcp:101:bash.0 00010000:00010000:3.0:1788925320.432520:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925320.432553:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a291591 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd93 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.432644:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.432659:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.432683:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.432704:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.432712:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.432718:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433409:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433454:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433462:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433468:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8c600 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925320.433477:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433485:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433505:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ee00) 00010000:00010000:2.0:1788925320.433509:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925320.433518:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433525:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c600/0xb29fc47e1a291598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433542:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433548:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433554:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433559:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8c800 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925320.433572:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433578:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433587:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff9e0d1810e500) 00010000:00010000:2.0:1788925320.433589:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925320.433592:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433598:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a29159f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433654:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a291591 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd93 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433665:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ee00) 00010000:00010000:2.0:1788925320.433670:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788925320.433675:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a291591 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd93 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.433686:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8ca00, rc 0) 00000100:00100000:2.0:1788925320.434001:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:7674:x1875823892116224:12345-192.168.203.4@tcp:101:bash.0 Request processed in 1508us (3335us total) trans 0 rc 301/301 00000100:00100000:2.0:1788925320.434010:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:3.0:1788925320.439592:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925320.442536:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892116352 00000100:00100000:2.0:1788925320.442551:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892116352 00000100:00100000:2.0:1788925320.442624:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1788925320.442636:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:7674:x1875823892116352:12345-192.168.203.4@tcp:37:bash.0 00000100:00100000:3.0:1788925320.450008:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:7674:x1875823892116352:12345-192.168.203.4@tcp:37:bash.0 Request processed in 7185us (10239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925320.450026:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:2.0:1788925320.466657:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.467020:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892116480 00000100:00100000:0.0:1788925320.467030:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892116480 00000100:00100000:0.0:1788925320.467197:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788925320.467209:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10469:x1875823892116480:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1788925320.467231:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925320.467254:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a2915a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bd9a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467351:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467364:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467375:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467438:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467447:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467454:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467693:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467701:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467708:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467714:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00031800 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925320.467718:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467833:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467847:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ee00) 00010000:00010000:0.0:1788925320.467850:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925320.467855:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467861:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a2915ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467875:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467880:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467885:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467890:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00031e00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925320.467892:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467898:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467905:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff9e0d1297ec00) 00010000:00010000:0.0:1788925320.467907:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925320.467910:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467927:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467960:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a2915a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd9a expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467970:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ee00) 00010000:00010000:0.0:1788925320.467971:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925320.467975:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a2915a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd9a expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.467984:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00030c00, rc 0) 00000100:00100000:0.0:1788925320.468304:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10469:x1875823892116480:12345-192.168.203.4@tcp:101:rm.0 Request processed in 1096us (1654us total) trans 0 rc 301/301 00000100:00100000:0.0:1788925320.468313:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1788925320.590337:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925320.590409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925320.590603:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892116736 00000100:00100000:2.0:1788925320.590673:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892116736 00000100:00100000:2.0:1788925320.590731:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788925320.590762:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10474:x1875823892116736:12345-192.168.203.4@tcp:700:mkdir.0 00000100:00100000:2.0:1788925320.590840:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10474:x1875823892116736:12345-192.168.203.4@tcp:700:mkdir.0 Request processed in 100us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925320.590848:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:0.0:1788925320.592701:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892116608 00000100:00100000:0.0:1788925320.592715:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892116608 00000100:00100000:0.0:1788925320.592843:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:0.0:1788925320.592854:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892116608:12345-192.168.203.4@tcp:41:mkdir.0 00000004:00000024:0.0:1788925320.592895:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788925320.592984:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892116608:12345-192.168.203.4@tcp:41:mkdir.0 Request processed in 132us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925320.592992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:1.0:1788925320.598938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925320.598974:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892116992 00000100:00100000:1.0:1788925320.598983:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892116992 00000100:00100000:1.0:1788925320.599039:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:1.0:1788925320.600162:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10474:x1875823892116992:12345-192.168.203.4@tcp:36:mkdir.0 00010000:00010000:1.0:1788925320.600221:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925320.600246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ce00/0xb29fc47e1a29148e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bd69 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.600264:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ee00) 00010000:00010000:1.0:1788925320.600274:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788925320.600653:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.600668:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.600678:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.600855:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.600863:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.600870:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925320.603036:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788925320.603055:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.603204:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.603223:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.603229:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148be00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925320.603234:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.603241:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.603256:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d03df8200) 00010000:00010000:1.0:1788925320.603259:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925320.603264:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.603270:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925320.603290:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016f9aa95 reply state 00000000578df8e6 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925320.603299:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788925320.603527:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+7:10474:x1875823892116992:12345-192.168.203.4@tcp:36:mkdir.0 Request processed in 3473us (4596us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788925320.603536:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00010000:00010000:3.0:1788925320.611302:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.611341:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.611349:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.611355:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148ae00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:3.0:1788925320.611360:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.611368:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.611385:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e0d03df8900) 00010000:00010000:3.0:1788925320.611388:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925320.611393:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.611399:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a2915c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925320.623220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.623283:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892117120 00000100:00100000:0.0:1788925320.623293:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892117120 00000100:00100000:0.0:1788925320.623357:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:0.0:1788925320.623369:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10475:x1875823892117120:12345-192.168.203.4@tcp:101:chmod.0 00010000:00010000:0.0:1788925320.623582:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925320.623608:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a2915c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bda1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.623683:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.623695:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.623706:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925320.623924:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788925320.623929:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788925320.623975:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.624003:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a2915c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bda1 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.624021:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bda1 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.624030:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1297ec00) 00010000:00010000:0.0:1788925320.624032:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788925320.624036:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00031e00, rc 0) 00000100:00100000:0.0:1788925320.624141:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+7:10475:x1875823892117120:12345-192.168.203.4@tcp:101:chmod.0 Request processed in 774us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925320.624148:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:1.0:1788925320.631595:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925320.631662:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892117376 00000100:00100000:2.0:1788925320.631672:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892117376 00000100:00100000:2.0:1788925320.631728:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788925320.631739:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+7:10475:x1875823892117376:12345-192.168.203.4@tcp:36:chmod.0 00010000:00010000:2.0:1788925320.631834:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925320.631860:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a2915d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bda1 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.631879:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1297ec00) 00010000:00010000:2.0:1788925320.631889:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925320.631913:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.631927:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.631936:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925320.632247:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fb24f7e reply state 000000006835c908 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925320.632263:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788925320.632276:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788925320.632359:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:10475:x1875823892117376:12345-192.168.203.4@tcp:36:chmod.0 Request processed in 622us (772us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788925320.632367:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00010000:00010000:2.0:1788925320.634042:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.634067:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.634075:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.634081:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed8000 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925320.634085:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.634092:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.634107:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286200) 00010000:00010000:2.0:1788925320.634109:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788925320.634123:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.634130:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915d7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925320.675437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925320.675660:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892117504 00000100:00100000:2.0:1788925320.675684:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892117504 00000100:00100000:2.0:1788925320.675780:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788925320.675791:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+7:10476:x1875823892117504:12345-192.168.203.4@tcp:101:chown.0 00010000:00010000:2.0:1788925320.675813:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925320.675845:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bda8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.675912:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9400/0xb29fc47e1a2915e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.675926:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9400/0xb29fc47e1a2915e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.675937:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9400/0xb29fc47e1a2915e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925320.675995:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788925320.676000:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788925320.676045:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9400/0xb29fc47e1a2915e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.676085:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2915de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bda8 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.676103:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9400/0xb29fc47e1a2915e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bda8 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.676350:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286200) 00010000:00010000:2.0:1788925320.676353:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925320.676357:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed9400, rc 0) 00000100:00100000:2.0:1788925320.676728:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:10476:x1875823892117504:12345-192.168.203.4@tcp:101:chown.0 Request processed in 627us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925320.676736:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:0.0:1788925320.690499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925320.690987:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892117632 00000100:00100000:1.0:1788925320.691000:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892117632 00000100:00100000:1.0:1788925320.691098:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1788925320.691110:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+8:10476:x1875823892117632:12345-192.168.203.4@tcp:101:chown.0 00010000:00010000:1.0:1788925320.691149:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925320.691178:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a2915ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdaf expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.691267:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.691284:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.691297:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.691316:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.691323:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.691331:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.691558:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.691568:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.691576:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925320.691635:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788925320.691639:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788925320.692853:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.692897:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.692906:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.692915:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.692923:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148ac00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925320.692929:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.692938:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.692959:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286200) 00010000:00010000:1.0:1788925320.692963:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925320.692968:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.692975:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a2915f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.692995:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.693022:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.693029:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.693034:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148be00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925320.693038:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.693045:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.693111:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e0d03df8200) 00010000:00010000:1.0:1788925320.693123:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925320.693126:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.693133:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a2915fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.693190:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a2915ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdaf expref: 10 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.693207:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdaf expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.693215:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8100) 00010000:00010000:1.0:1788925320.693218:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788925320.693226:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148ae00, rc 0) 00000100:00100000:1.0:1788925320.693326:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+9:10476:x1875823892117632:12345-192.168.203.4@tcp:101:chown.0 Request processed in 2216us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925320.693337:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:1.0:1788925320.697655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.698301:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892117888 00000100:00100000:0.0:1788925320.698317:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892117888 00000100:00100000:0.0:1788925320.698397:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1788925320.698411:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+9:10476:x1875823892117888:12345-192.168.203.4@tcp:36:chown.0 00010000:00010000:0.0:1788925320.698483:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925320.698519:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291601 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdaf expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.698544:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8100) 00010000:00010000:0.0:1788925320.698560:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788925320.698598:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.698616:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.698626:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788925320.753135:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788925320.753410:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4e26e9c reply state 0000000076e97cdf transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925320.753425:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788925320.753639:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1788925320.754018:0:5838:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788925320.754064:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+7:10476:x1875823892117888:12345-192.168.203.4@tcp:36:chown.0 Request processed in 55652us (56421us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788925320.754073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00010000:00010000:3.0:1788925320.755333:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.755347:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.755354:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.755380:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00030c00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:3.0:1788925320.755385:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.755392:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.755408:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d1297e300) 00010000:00010000:3.0:1788925320.755411:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788925320.755416:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.755422:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a291608 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925320.775671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925320.775819:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892118016 00000100:00100000:2.0:1788925320.775829:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892118016 00000100:00100000:2.0:1788925320.775897:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788925320.775908:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10477:x1875823892118016:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:2.0:1788925320.775933:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925320.775961:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9600/0xb29fc47e1a29160f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdb6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788925320.777819:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1809us 00010000:00010000:1.0:1788925320.794126:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794151:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794164:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794181:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794188:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794195:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794599:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a291624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794608:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a291624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794615:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a291624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925320.794699:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788925320.794704:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788925320.794837:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a291624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794851:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794857:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794863:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794868:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148a400 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925320.794872:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794879:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794891:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286200) 00010000:00010000:1.0:1788925320.794894:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925320.794898:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794904:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a400/0xb29fc47e1a291616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794916:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794931:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794937:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794942:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148be00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925320.794945:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794951:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794959:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e0d03df8200) 00010000:00010000:1.0:1788925320.794962:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925320.794964:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.794971:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148be00/0xb29fc47e1a29161d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.795006:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9600/0xb29fc47e1a29160f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdb6 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.795021:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a291624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdb6 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.795028:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8e00) 00010000:00010000:1.0:1788925320.795031:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788925320.795038:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d0148ac00, rc 0) 00000100:00100000:1.0:1788925320.795111:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+7:10477:x1875823892118016:12345-192.168.203.4@tcp:101:touch.500 Request processed in 19204us (19446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925320.795130:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:2.0:1788925320.799783:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925320.799897:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892118272 00000100:00100000:1.0:1788925320.799906:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892118272 00000100:00100000:1.0:1788925320.799963:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788925320.799973:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+7:10477:x1875823892118272:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:1.0:1788925320.799992:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925320.800011:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a600/0xb29fc47e1a29162b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdbd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.800331:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.800346:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.800357:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.800374:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.800381:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.800387:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788925320.801312:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788925320.801588:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a291640 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.801602:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a291640 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.801611:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a291640 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.801643:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.801651:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.801659:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.801665:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148a800 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925320.802310:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.802323:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.802337:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8e00) 00010000:00010000:1.0:1788925320.802340:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925320.802344:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.802351:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a800/0xb29fc47e1a291632 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925320.802382:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000661d987d reply state 000000000f55079d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925320.802390:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788925320.802428:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148a600/0xb29fc47e1a29162b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdbd expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.802443:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a291640 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdbd expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.802450:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e0d03df8000) 00010000:00010000:1.0:1788925320.802452:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788925320.802454:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d42045400, rc 0) 00000100:00100000:1.0:1788925320.802530:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+10:10477:x1875823892118272:12345-192.168.203.4@tcp:101:touch.500 Request processed in 2558us (2786us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788925320.802539:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00010000:00010000:2.0:1788925320.806449:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.806465:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.806471:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.806478:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d0148ae00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925320.806483:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.806506:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.806523:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8137be4d (ffff9e0d03df8a00) 00010000:00010000:2.0:1788925320.806526:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925320.806530:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.806537:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ae00/0xb29fc47e1a291639 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925320.815102:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925320.815182:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892118528 00000100:00100000:1.0:1788925320.815191:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892118528 00000100:00100000:1.0:1788925320.815248:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:1.0:1788925320.815258:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+9:10477:x1875823892118528:12345-192.168.203.4@tcp:36:touch.500 00010000:00010000:1.0:1788925320.815313:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925320.815338:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a291640 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdbd expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.815356:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e0d03df8000) 00010000:00010000:1.0:1788925320.815365:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788925320.815420:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.815432:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.815442:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925320.815563:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a63977e7 reply state 0000000065191c27 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925320.815573:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788925320.815654:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+10:10477:x1875823892118528:12345-192.168.203.4@tcp:36:touch.500 Request processed in 397us (561us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788925320.815662:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1788925320.821633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00010000:00010000:3.0:1788925320.821676:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.821688:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.821695:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.821702:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045000 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:3.0:1788925320.821707:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.821715:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.821770:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e0d03df8200) 00010000:00010000:3.0:1788925320.821774:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925320.821779:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.821786:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045000/0xb29fc47e1a29164e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925320.824533:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892118656 00000100:00100000:2.0:1788925320.824547:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892118656 00000100:00100000:2.0:1788925320.824619:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:2.0:1788925320.824629:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+9:10477:x1875823892118656:12345-192.168.203.4@tcp:101:touch.500 00010000:00010000:2.0:1788925320.824654:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925320.824676:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a291655 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdc4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.824737:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a291655 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdc4 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.824773:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a291655 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdc4 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.824791:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e0d25286800) 00010000:00010000:2.0:1788925320.824794:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788925320.824810:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed9200, rc 0) 00000100:00100000:2.0:1788925320.824870:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+10:10477:x1875823892118656:12345-192.168.203.4@tcp:101:touch.500 Request processed in 242us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925320.824878:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:3.0:1788925320.828942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.829150:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892118784 00000100:00100000:0.0:1788925320.829161:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892118784 00000100:00100000:0.0:1788925320.829217:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:0.0:1788925320.829226:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2381:x1875823892118784:12345-192.168.203.4@tcp:8:touch.500 00010000:00080000:0.0:1788925320.829259:0:10659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:0.0:1788925320.829300:0:10659:0:(genops.c:1385:class_connect()) connect: client da20ab87-237b-453b-b2c0-9c81ec453d80, cookie 0xb29fc47e1a29165c 00002000:00100000:0.0:1788925320.829311:0:10659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli da20ab87-237b-453b-b2c0-9c81ec453d80/ffff9e0d357d3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788925320.829334:0:10659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788925320.830055:0:10659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788925320.830087:0:10659:0:(import.c:65:import_set_state_nolock()) ffff9e0d357d4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925320.830213:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2381:x1875823892118784:12345-192.168.203.4@tcp:8:touch.500 Request processed in 985us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925320.830222:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:1.0:1788925320.839517:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925320.839600:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892118912 00000100:00100000:3.0:1788925320.839610:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892118912 00000100:00100000:3.0:1788925320.839689:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:3.0:1788925320.839700:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:0:x1875823892118912:12345-192.168.203.4@tcp:2:touch.500 00000100:00080000:1.0:1788925320.840351:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788925320.888409:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da20ab87-237b-453b-b2c0-9c81ec453d80 00000001:00080000:1.0:1788925320.888427:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788925320.888605:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:0:x1875823892118912:12345-192.168.203.4@tcp:2:touch.500 Request processed in 48902us (49093us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788925320.888616:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1788925320.891656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925320.892065:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892119168 00000100:00100000:3.0:1788925320.892074:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892119168 00000100:00100000:3.0:1788925320.892135:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788925320.892145:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+10:10477:x1875823892119168:12345-192.168.203.4@tcp:35:touch.500 00000100:00100000:3.0:1788925320.892585:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+11:10477:x1875823892119168:12345-192.168.203.4@tcp:35:touch.500 Request processed in 440us (938us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788925320.892594:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:2.0:1788925320.905686:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925320.905775:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892119296 00000100:00100000:1.0:1788925320.905784:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892119296 00000100:00100000:1.0:1788925320.905835:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788925320.905844:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+11:10478:x1875823892119296:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1788925320.905868:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925320.905886:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a291663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdcb expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.905943:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a29166a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.905987:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a29166a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.905998:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a29166a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925320.906050:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788925320.906053:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788925320.906090:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a29166a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.906125:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a291663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdcb expref: 13 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.906143:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a29166a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdcb expref: 12 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925320.906153:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8e00) 00010000:00010000:1.0:1788925320.906155:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788925320.906159:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d42045c00, rc 0) 00000100:00100000:1.0:1788925320.906266:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+12:10478:x1875823892119296:12345-192.168.203.4@tcp:101:rm.0 Request processed in 421us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925320.906273:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788925320.910374:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925320.910465:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892119552 00000100:00100000:2.0:1788925320.910476:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892119552 00000100:00100000:2.0:1788925320.910534:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1788925320.910545:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+12:10478:x1875823892119552:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:2.0:1788925320.910567:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925320.910587:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a291671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdd2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925320.910713:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788925320.910907:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a291671 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdd2 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.910921:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286200) 00010000:00010000:2.0:1788925320.910924:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788925320.910929:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a291671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdd2 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.910942:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed9a00, rc 0) 00000100:00100000:2.0:1788925320.911022:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+13:10478:x1875823892119552:12345-192.168.203.4@tcp:101:rm.0 Request processed in 479us (657us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788925320.911030:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:1.0:1788925320.920068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.920160:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892119680 00000100:00100000:0.0:1788925320.920170:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892119680 00000100:00100000:0.0:1788925320.920221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:0.0:1788925320.920231:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+13:10478:x1875823892119680:12345-192.168.203.4@tcp:37:rm.0 00000100:00100000:0.0:1788925320.924479:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+13:10478:x1875823892119680:12345-192.168.203.4@tcp:37:rm.0 Request processed in 4238us (4410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925320.924492:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:1.0:1788925320.928279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925320.928407:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892119936 00000100:00100000:3.0:1788925320.928417:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892119936 00000100:00100000:3.0:1788925320.928475:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:3.0:1788925320.928487:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d32ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+13:10478:x1875823892119936:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:3.0:1788925320.928936:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d32ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+14:10478:x1875823892119936:12345-192.168.203.4@tcp:35:rm.0 Request processed in 450us (665us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788925320.928944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:1.0:1788925320.931945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.932165:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892120192 00000100:00100000:0.0:1788925320.932175:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892120192 00000100:00100000:0.0:1788925320.932238:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1788925320.932249:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+14:10478:x1875823892120192:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1788925320.932275:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925320.932299:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a29167f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdd9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.932411:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291686 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.932424:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.932446:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291686 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925320.932458:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788925320.932607:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a29167f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdd9 expref: 17 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.932626:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291686 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdd9 expref: 16 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.932635:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8e00) 00010000:00010000:0.0:1788925320.932638:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788925320.932641:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d00031800, rc 0) 00000100:00100000:0.0:1788925320.932700:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+16:10478:x1875823892120192:12345-192.168.203.4@tcp:101:rm.0 Request processed in 452us (766us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788925320.932707:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:2.0:1788925320.937694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.937840:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892120320 00000100:00100000:0.0:1788925320.937850:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892120320 00000100:00100000:0.0:1788925320.937898:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1788925320.937908:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+16:10478:x1875823892120320:12345-192.168.203.4@tcp:41:rm.0 00000004:00000024:0.0:1788925320.937976:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788925320.938042:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+16:10478:x1875823892120320:12345-192.168.203.4@tcp:41:rm.0 Request processed in 135us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925320.938049:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788925320.940433:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.940541:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892120448 00000100:00100000:0.0:1788925320.940549:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892120448 00000100:00100000:0.0:1788925320.940611:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:0.0:1788925320.940621:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+16:10478:x1875823892120448:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:0.0:1788925320.940638:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925320.940657:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a291694 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bde0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.940735:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.940936:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.940947:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.940978:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.940986:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.940994:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941099:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5000/0xb29fc47e1a2916a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941107:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5000/0xb29fc47e1a2916a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941124:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5000/0xb29fc47e1a2916a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925320.941161:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788925320.941166:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788925320.941185:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5000/0xb29fc47e1a2916a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941198:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5000/0xb29fc47e1a2916a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941205:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941211:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941217:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941222:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d00030c00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925320.941226:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941232:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941243:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8e00) 00010000:00010000:0.0:1788925320.941246:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925320.941251:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941257:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00030c00/0xb29fc47e1a29169b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941281:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941286:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941291:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941296:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4800 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925320.941299:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941304:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941312:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8137be4d (ffff9e0d1297e100) 00010000:00010000:0.0:1788925320.941314:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925320.941317:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941322:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4800/0xb29fc47e1a2916a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941352:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031e00/0xb29fc47e1a291694 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bde0 expref: 18 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941366:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5000/0xb29fc47e1a2916a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bde0 expref: 17 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.941384:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e0d25286800) 00010000:00010000:0.0:1788925320.941387:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788925320.941390:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d2e5e5000, rc 0) 00000100:00100000:0.0:1788925320.941501:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+17:10478:x1875823892120448:12345-192.168.203.4@tcp:101:rm.0 Request processed in 881us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925320.941509:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1788925320.945041:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925320.945130:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892120704 00000100:00100000:0.0:1788925320.945140:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892120704 00000100:00100000:0.0:1788925320.945230:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1788925320.945241:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+17:10478:x1875823892120704:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:0.0:1788925320.945294:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788925320.945321:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5000/0xb29fc47e1a2916a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bde0 expref: 17 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945343:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a291655 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdc4 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945354:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e0d25286800) 00010000:00010000:0.0:1788925320.945369:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a29166a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdcb expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945378:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8e00) 00010000:00010000:0.0:1788925320.945381:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788925320.945400:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945431:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945440:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945455:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945463:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945470:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945579:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945586:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.945593:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788925320.946366:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788925320.946376:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329873631748ns, next at 330873629728ns, rc = 0 00010000:00010000:0.0:1788925320.946436:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946447:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946466:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946475:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946481:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946487:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946515:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925320.946534:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946539:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946544:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946549:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e5a00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925320.946553:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946560:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946571:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:0.0:1788925320.946574:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788925320.946583:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946589:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a2916be lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946604:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946610:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946616:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946621:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4400 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925320.946624:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946630:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946638:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8e00) 00010000:00010000:0.0:1788925320.946641:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925320.946643:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.946648:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a2916b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788925320.946658:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002eeaca29 reply state 00000000d719eb42 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925320.946676:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788925320.946789:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+16:10478:x1875823892120704:12345-192.168.203.4@tcp:36:rm.0 Request processed in 1548us (1753us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788925320.946798:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00010000:00010000:3.0:1788925320.946872:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925320.946879:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.946884:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4a00 already unused, calling callback (ffffffffc141f230) 00010000:00010000:3.0:1788925320.946888:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.946893:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.946902:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:3.0:1788925320.946904:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788925320.946907:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.946914:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4a00/0xb29fc47e1a2916c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.946927:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925320.946929:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925320.946931:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925320.952273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925320.952381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892120960 00000100:00100000:3.0:1788925320.952390:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892120960 00000100:00100000:3.0:1788925320.952448:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788925320.952458:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+16:10478:x1875823892120960:12345-192.168.203.4@tcp:35:rm.0 00000100:00100000:3.0:1788925320.952776:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+17:10478:x1875823892120960:12345-192.168.203.4@tcp:35:rm.0 Request processed in 319us (511us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788925320.952798:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:1.0:1788925320.955147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925320.955370:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892121216 00000100:00100000:2.0:1788925320.955379:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892121216 00000100:00100000:2.0:1788925320.955432:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:2.0:1788925320.955443:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+17:10478:x1875823892121216:12345-192.168.203.4@tcp:36:rm.0 00010000:00010000:2.0:1788925320.955496:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788925320.955524:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d00031800/0xb29fc47e1a291686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdd9 expref: 17 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.955546:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d0148ac00/0xb29fc47e1a291624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdb6 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.955558:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d03df8e00) 00010000:00010000:2.0:1788925320.955572:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9400/0xb29fc47e1a2915e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bda8 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.955583:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286200) 00010000:00010000:2.0:1788925320.955589:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925320.955610:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.955621:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.955630:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.955642:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.955663:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.955735:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.956194:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.956204:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.956211:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.957038:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.957051:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.957057:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.957063:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e5600 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925320.957067:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.957074:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.957088:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x8137be4d (ffff9e0d1297e400) 00010000:00010000:0.0:1788925320.957091:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925320.957095:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925320.957102:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5600/0xb29fc47e1a2916b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x8137be4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925320.957327:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788925320.957343:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957350:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957357:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957363:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed8000 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925320.957366:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957373:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957393:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e0d25286a00) 00010000:00010000:2.0:1788925320.957396:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788925320.957400:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957405:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a2916da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957423:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957430:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957435:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957440:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed8a00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925320.957442:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957448:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957455:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286600) 00010000:00010000:2.0:1788925320.957457:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925320.957460:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925320.957466:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a2916cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925320.957489:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012531349 reply state 00000000108edf98 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925320.957497:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788925320.957616:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+15:10478:x1875823892121216:12345-192.168.203.4@tcp:36:rm.0 Request processed in 2173us (2473us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788925320.957625:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00010000:00010000:3.0:1788925320.965955:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.965973:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.965981:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.965988:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9000 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:3.0:1788925320.965993:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.966000:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.966018:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e0d25286b00) 00010000:00010000:3.0:1788925320.966022:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925320.966026:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925320.966033:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a2916d3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925321.281049:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911035904:0@lo:400:kworker.0 00000100:00100000:3.0:1788925321.281128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925321.281181:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823911035648:0@lo:400:kworker.0 00000100:00100000:3.0:1788925321.281198:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788925321.281203:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911035776:0@lo:400:kworker.0 00000100:00100000:2.0:1788925321.281216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925321.281225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925321.281240:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823911036160:0@lo:400:kworker.0 00000100:00100000:3.0:1788925321.281253:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911036288:0@lo:400:kworker.0 00000100:00100000:2.0:1788925321.281258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925321.281273:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925321.281274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925321.281278:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d066b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911036032:0@lo:400:kworker.0 00000100:00100000:2.0:1788925321.281296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925321.281303:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911035648 00000100:00100000:3.0:1788925321.281311:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911035648 00000100:00100000:2.0:1788925321.281330:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911036288 00000100:00100000:2.0:1788925321.281333:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911036288 00000100:00100000:3.0:1788925321.281352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788925321.281361:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3307:x1875823911035648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925321.281362:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911036032 00000100:00100000:2.0:1788925321.281364:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911036032 00000100:00100000:2.0:1788925321.281380:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788925321.281385:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911036288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925321.281420:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911036288:12345-0@lo:400:kworker.0 Request processed in 34us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925321.281426:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3307:x1875823911035648:12345-0@lo:400:kworker.0 Request processed in 67us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925321.281426:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788925321.281431:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788925321.281441:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788925321.281446:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911036032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925321.281469:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:76f68b46-a017-4297-a662-44212e04e46d:3307:1875823911035648:0@lo:400:kworker.0 00000100:00100000:2.0:1788925321.281471:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911036032:12345-0@lo:400:kworker.0 Request processed in 25us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925321.281482:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788925321.281490:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d066b0e00 x1875823911036032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925321.281502:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911036032:0@lo:400:kworker.0 00010000:00080000:2.0:1788925321.281520:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d066b3800 x1875823911036288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925321.281529:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911036288:0@lo:400:kworker.0 00000100:00100000:0.0:1788925321.281601:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911035904 00000100:00100000:0.0:1788925321.281605:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911035904 00000100:00100000:0.0:1788925321.281643:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911035776 00000100:00100000:0.0:1788925321.281646:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911035776 00000100:00100000:0.0:1788925321.281659:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911036160 00000100:00100000:0.0:1788925321.281661:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911036160 00000100:00100000:0.0:1788925321.281674:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788925321.281681:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911035904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925321.281727:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875823911035904:12345-0@lo:400:kworker.0 Request processed in 47us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925321.281734:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788925321.281767:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788925321.281774:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d40eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911035776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925321.281811:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d40eb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911035776:12345-0@lo:400:kworker.0 Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925321.281816:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788925321.281827:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788925321.281843:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823911036160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925321.281873:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875823911036160:12345-0@lo:400:kworker.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925321.281879:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1788925321.281995:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925321.282000:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925321.282282:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875823911036160:0@lo:400:kworker.0 00000100:00100000:3.0:1788925321.282316:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911035776:0@lo:400:kworker.0 00000100:00100000:3.0:1788925321.282325:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d066b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875823911035904:0@lo:400:kworker.0 00010000:00010000:3.0:1788925321.345018:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925321.798081:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925321.798119:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911036416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925321.798192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925321.798928:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911036416 00000100:00100000:2.0:1788925321.798938:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911036416 00000100:00100000:2.0:1788925321.798995:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788925321.799005:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911036416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925321.799027:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925321.799083:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911036416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925321.799090:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788925321.799215:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2f75ca80 x1875823911036416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925321.799234:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911036416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925322.369015:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925323.393323:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925323.436126:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925323.436175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925323.436213:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925323.436303:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892121344 00000100:00100000:2.0:1788925323.436315:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892121344 00000100:00100000:2.0:1788925323.436380:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:2.0:1788925323.436391:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892121344:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925323.436462:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2383:x1875823892121344:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 73us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925323.436469:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 244 00000100:00100000:3.0:1788925323.437206:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892121600 00000100:00100000:3.0:1788925323.437213:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892121600 00000100:00100000:3.0:1788925323.437298:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00100000:3.0:1788925323.437307:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2383:x1875823892121600:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925323.437351:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2383:x1875823892121600:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 46us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925323.437358:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 60 00000100:00080000:2.0:1788925323.437632:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925323.438077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892121472 00000100:00100000:0.0:1788925323.438083:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892121472 00000100:00100000:0.0:1788925323.438141:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00100000:0.0:1788925323.438148:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+14:2383:x1875823892121472:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925323.438200:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+14:2383:x1875823892121472:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 52us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925323.438206:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 113 00000100:00080000:2.0:1788925323.438661:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925324.416943:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925325.376981:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925325.377004:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911036544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925325.377072:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925325.377310:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911036544 00000100:00100000:2.0:1788925325.377318:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911036544 00000100:00100000:2.0:1788925325.377389:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788925325.377400:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911036544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925325.377451:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925325.377505:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911036544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925325.377511:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788925325.377550:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2f75e300 x1875823911036544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925325.377569:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911036544:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788925325.377669:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788925325.440954:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788925325.936489:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1788925325.936500:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788925325.936528:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1788925325.936723:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925325.937019:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d105c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911036672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788925325.937104:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925325.937387:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911036672 00000100:00100000:3.0:1788925325.937394:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911036672 00000100:00100000:3.0:1788925325.937504:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925325.937515:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911036672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788925325.937541:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788925325.937575:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa0d588, atime: 0x6aa0d588, ctime: 0x6aa0d588, blocks: 0x1 00010000:00010000:3.0:1788925325.937583:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925325.937599:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1788925325.937603:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925325.937609:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925325.937815:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925325.937827:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925325.937837:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925325.937897:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788925325.938500:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823911036672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 984us (1393us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788925325.938509:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788925325.938696:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e0d105c6d80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788925325.938704:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d105c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911036672:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1788925325.938959:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788925325.939032:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925325.939040:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925325.939050:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8d800 already unused, calling callback (ffffffffc141f230) 00010000:00010000:0.0:1788925325.939054:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925325.939062:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925325.939091:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925325.939098:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d1b4a3d/0xb29fc47e1a2916e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925325.939119:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925325.939121:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925325.939122:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925326.401050:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3546b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911037184:0@lo:400:kworker.0 00000100:00100000:1.0:1788925326.401132:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925326.401456:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925326.401463:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d35468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911037056:0@lo:400:kworker.0 00000100:00100000:1.0:1788925326.401488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925326.401525:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911037184 00000100:00100000:1.0:1788925326.401532:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911037184 00000100:00100000:1.0:1788925326.401578:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788925326.401587:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3546a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911037184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925326.401637:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3546a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911037184:12345-0@lo:400:kworker.0 Request processed in 50us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925326.401644:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788925326.401664:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911037056 00000100:00100000:1.0:1788925326.401668:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911037056 00000100:00100000:1.0:1788925326.401698:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788925326.401705:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911037056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925326.401736:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911037056:12345-0@lo:400:kworker.0 Request processed in 32us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925326.401776:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788925326.401799:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925326.401828:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d35468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911037056:0@lo:400:kworker.0 00010000:00080000:1.0:1788925326.401842:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d3546b800 x1875823911037184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925326.401866:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3546b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911037184:0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.402130:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d105c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911036800:0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.402177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925326.402210:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d35469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911037312:0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.402232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925326.402254:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788925326.402259:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3546a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911036928:0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.402281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925326.402294:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d3546ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911037440:0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.402512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925326.402543:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911037312 00000100:00100000:3.0:1788925326.402546:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911037312 00000100:00100000:3.0:1788925326.402587:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911036928 00000100:00100000:3.0:1788925326.402591:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911036928 00000100:00100000:3.0:1788925326.402611:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788925326.402618:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911037312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.402658:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875823911037312:12345-0@lo:400:kworker.0 Request processed in 41us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925326.402664:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788925326.402676:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788925326.402683:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911036928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.402708:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875823911036928:12345-0@lo:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925326.402714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788925326.402734:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911037440 00000100:00100000:3.0:1788925326.402737:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911037440 00000100:00100000:3.0:1788925326.402778:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788925326.402784:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875823911037440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.402814:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875823911037440:12345-0@lo:400:kworker.0 Request processed in 31us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925326.402820:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788925326.402832:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925326.402965:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911036800 00000100:00100000:1.0:1788925326.402971:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911036800 00000100:00100000:1.0:1788925326.403000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788925326.403006:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911036800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925326.403039:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76f68b46-a017-4297-a662-44212e04e46d+19:3304:x1875823911036800:12345-0@lo:400:kworker.0 Request processed in 34us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925326.403044:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788925326.403230:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3546a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875823911036928:0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.403247:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d3546ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911037440:0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.403255:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d105c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:76f68b46-a017-4297-a662-44212e04e46d:3304:1875823911036800:0@lo:400:kworker.0 00000100:00100000:3.0:1788925326.403264:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d35469f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875823911037312:0@lo:400:kworker.0 00010000:00010000:3.0:1788925326.464955:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925326.543501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925326.543687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892121728 00000100:00100000:3.0:1788925326.543703:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892121728 00000100:00100000:3.0:1788925326.543813:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:3.0:1788925326.543823:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:10990:x1875823892121728:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:3.0:1788925326.543841:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925326.543862:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a2916e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bde7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925326.543922:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8d800/0xb29fc47e1a2916ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925326.543935:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8d800/0xb29fc47e1a2916ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925326.543948:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8d800/0xb29fc47e1a2916ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925326.544151:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788925326.544156:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788925326.544223:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8d800/0xb29fc47e1a2916ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925326.544247:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a2916e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bde7 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925326.544263:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8d800/0xb29fc47e1a2916ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bde7 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925326.544272:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ec00) 00010000:00010000:3.0:1788925326.544275:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788925326.544285:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8d800, rc 0) 00000100:00100000:3.0:1788925326.544345:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10990:x1875823892121728:12345-192.168.203.4@tcp:101:rm.0 Request processed in 523us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925326.544352:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00080000:1.0:1788925326.544544:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925326.551300:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925326.553679:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892121856 00000100:00100000:1.0:1788925326.553703:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892121856 00000100:00100000:1.0:1788925326.553806:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:1.0:1788925326.553819:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10990:x1875823892121856:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1788925326.553840:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925326.553862:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2916f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.553928:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.553941:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.553968:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554021:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554030:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554037:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554297:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554305:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554312:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554318:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044600 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925326.554323:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554330:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554342:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ec00) 00010000:00010000:1.0:1788925326.554346:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925326.554350:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554363:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2916fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554377:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554384:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554390:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554395:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045c00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925326.554398:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554404:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554412:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff9e0d03df8000) 00010000:00010000:1.0:1788925326.554415:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925326.554417:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554422:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291704 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554453:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2916f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdee expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554474:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ec00) 00010000:00010000:1.0:1788925326.554477:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788925326.554481:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2916f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdee expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925326.554490:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d42044c00, rc 0) 00000100:00100000:1.0:1788925326.554568:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:10990:x1875823892121856:12345-192.168.203.4@tcp:101:rm.0 Request processed in 752us (3275us total) trans 0 rc 301/301 00000100:00100000:1.0:1788925326.554576:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:0.0:1788925326.915476:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911037568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925326.915554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925326.915770:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911037568 00000100:00100000:2.0:1788925326.915778:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911037568 00000100:00100000:2.0:1788925326.915821:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788925326.915830:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823911037568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925326.915864:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788925326.915926:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875823911037568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925326.915933:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788925326.916132:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911037568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788925327.489066:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925328.512989:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925328.554234:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925328.554282:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925328.554332:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925328.554349:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892121984 00000100:00100000:1.0:1788925328.554368:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892121984 00000100:00100000:1.0:1788925328.554459:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:1.0:1788925328.554474:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892121984:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925328.554566:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892122112 00000100:00100000:2.0:1788925328.554577:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892122112 00000100:00100000:1.0:1788925328.554577:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892121984:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 104us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925328.554590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 246 00000100:00100000:2.0:1788925328.554663:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:2.0:1788925328.554675:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892122112:12345-192.168.203.4@tcp:400:kworker.0 00000100:00080000:1.0:1788925328.554693:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925328.554802:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892122112:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 127us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925328.554812:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 117 00000100:00100000:3.0:1788925328.555397:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892122240 00000100:00100000:3.0:1788925328.555407:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892122240 00000100:00080000:1.0:1788925328.555597:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925328.558241:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 63 00000100:00100000:3.0:1788925328.558277:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892122240:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925328.558410:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3b0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892122240:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 152us (4126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925328.558420:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 63 00010000:00010000:0.0:1788925329.538314:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925330.499106:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d34e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911037696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925330.499205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925330.499551:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911037696 00000100:00100000:0.0:1788925330.499562:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911037696 00000100:00100000:0.0:1788925330.499634:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788925330.499647:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911037696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925330.499709:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925330.499792:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911037696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925330.499800:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788925330.500034:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788925330.500087:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d34e96a00 x1875823911037696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925330.500113:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d34e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911037696:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788925330.562974:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788925330.573628:0:11846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 157d: llapi changelog scanner API tests === 23:42:09 (1788925329) 00000100:00100000:3.0:1788925330.902844:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925330.903126:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892122368 00000100:00100000:1.0:1788925330.903140:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892122368 00000100:00100000:1.0:1788925330.903241:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:1.0:1788925330.903255:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d41dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:11367:x1875823892122368:12345-192.168.203.4@tcp:101:rm.0 00010000:00010000:1.0:1788925330.903284:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925330.903315:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a29170b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdf5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788925330.903387:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925330.903426:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.903445:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.903458:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.903478:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.903485:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.903493:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904033:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904043:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904058:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904065:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045c00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925330.904070:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904090:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904106:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ec00) 00010000:00010000:1.0:1788925330.904109:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925330.904114:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904119:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a291712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904133:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904139:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904144:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904149:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044600 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925330.904152:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904157:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904164:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf03956b8 (ffff9e0d03df8000) 00010000:00010000:1.0:1788925330.904167:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925330.904169:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904185:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a291719 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904228:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a29170b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdf5 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904240:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ec00) 00010000:00010000:1.0:1788925330.904242:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925330.904246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a29170b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdf5 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925330.904257:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d42044c00, rc 0) 00000100:00100000:1.0:1788925330.904351:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d41dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:11367:x1875823892122368:12345-192.168.203.4@tcp:101:rm.0 Request processed in 1099us (1530us total) trans 0 rc 301/301 00000100:00100000:1.0:1788925330.904360:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1788925330.935682:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925330.936077:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892122624 00000100:00100000:0.0:1788925330.936091:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892122624 00000100:00100000:0.0:1788925330.936168:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:0.0:1788925330.936179:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:11368:x1875823892122624:12345-192.168.203.4@tcp:36:lfs.0 00010000:00010000:0.0:1788925330.936253:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925330.936291:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8d800/0xb29fc47e1a2916ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bde7 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.936316:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1810ec00) 00010000:00010000:0.0:1788925330.936346:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788925330.937099:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.937119:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.937132:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.937149:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.937155:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.937161:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925330.941116:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788925330.941145:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.941158:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.941167:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.941174:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4400 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925330.941180:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.941203:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.941228:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1297e000) 00010000:00010000:0.0:1788925330.941231:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925330.941236:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925330.941242:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4400/0xb29fc47e1a291720 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788925330.941267:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a27a2cb9 reply state 000000005d4897d3 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925330.941276:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788925330.944193:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+7:11368:x1875823892122624:12345-192.168.203.4@tcp:36:lfs.0 Request processed in 7998us (8508us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788925330.944210:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00010000:00010000:3.0:1788925330.949210:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925330.949234:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925330.949243:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925330.949251:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e5a00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:3.0:1788925330.949257:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925330.949266:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925330.949316:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf03956b8 (ffff9e0d1297ed00) 00010000:00010000:3.0:1788925330.949320:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925330.949326:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925330.949333:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5a00/0xb29fc47e1a291727 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788925331.102399:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000001:00080000:1.0:1788925331.138309:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1788925331.525420:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911037952:0@lo:400:kworker.0 00000100:00100000:2.0:1788925331.525488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925331.525535:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911038464:0@lo:400:kworker.0 00000100:00100000:2.0:1788925331.525559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925331.525587:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788925331.525592:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911037824:0@lo:400:kworker.0 00000100:00100000:2.0:1788925331.525618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925331.525635:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911038336:0@lo:400:kworker.0 00000100:00100000:2.0:1788925331.525655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925331.525679:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911037952 00000100:00100000:2.0:1788925331.525686:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911037952 00000100:00100000:2.0:1788925331.525724:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911038336 00000100:00100000:2.0:1788925331.525727:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911038336 00000100:00100000:2.0:1788925331.525881:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788925331.525891:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911037952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925331.525943:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875823911037952:12345-0@lo:400:kworker.0 Request processed in 53us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925331.525949:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788925331.525965:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788925331.525971:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911038336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925331.525997:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911038336:12345-0@lo:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925331.526003:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788925331.526020:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911038464 00000100:00100000:2.0:1788925331.526030:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911038464 00000100:00100000:2.0:1788925331.526070:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788925331.526077:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911038464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925331.526108:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911038464:12345-0@lo:400:kworker.0 Request processed in 32us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925331.526114:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788925331.526133:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788925331.526137:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925331.526163:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911038336:0@lo:400:kworker.0 00000100:00100000:2.0:1788925331.526173:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875823911037952:0@lo:400:kworker.0 00000100:00100000:2.0:1788925331.526181:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788925331.526185:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e0d105c6d80, transno 4294967300 00000100:00100000:2.0:1788925331.526194:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911038464:0@lo:400:kworker.0 00000100:00100000:0.0:1788925331.526775:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911038080:0@lo:400:kworker.0 00000100:00100000:0.0:1788925331.526811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925331.526837:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925331.526843:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911038208:0@lo:400:kworker.0 00000100:00100000:0.0:1788925331.526865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925331.526904:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911037824 00000100:00100000:0.0:1788925331.526909:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911037824 00000100:00100000:0.0:1788925331.526942:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788925331.526949:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911037824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925331.526986:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911037824:12345-0@lo:400:kworker.0 Request processed in 38us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925331.527000:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788925331.527029:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911038080 00000100:00100000:0.0:1788925331.527034:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911038080 00000100:00100000:1.0:1788925331.528196:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911038208 00000100:00100000:1.0:1788925331.528205:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911038208 00000100:00100000:1.0:1788925331.528252:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788925331.528260:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911038208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925331.528330:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911038208:12345-0@lo:400:kworker.0 Request processed in 71us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925331.528337:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788925331.528503:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911037824:0@lo:400:kworker.0 00000100:00080000:2.0:1788925331.529017:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925331.529118:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788925331.529127:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911038080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925331.529175:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875823911038080:12345-0@lo:400:kworker.0 Request processed in 49us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925331.529182:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1788925331.529217:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e0d2f75c700 x1875823911038208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925331.529229:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911038208:0@lo:400:kworker.0 00000100:00100000:0.0:1788925331.529240:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875823911038080:0@lo:400:kworker.0 00010000:00010000:0.0:1788925331.584944:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925332.036997:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2f75ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911038592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925332.037078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925332.037147:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911038592 00000100:00100000:0.0:1788925332.037155:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911038592 00000100:00100000:0.0:1788925332.037198:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788925332.037207:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d34e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911038592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788925332.037239:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788925332.037279:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d34e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911038592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925332.037286:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788925332.037337:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2f75ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911038592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925332.609971:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788925332.954546:0:11947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00010000:0.0:1788925333.635189:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925333.674827:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925333.674869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925333.674898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925333.674929:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892123008 00000100:00100000:3.0:1788925333.674939:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892123008 00000100:00100000:3.0:1788925333.675005:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1788925333.675017:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2384:x1875823892123008:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925333.675100:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2384:x1875823892123008:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925333.675107:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 66 00000100:00100000:3.0:1788925333.675128:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892122880 00000100:00100000:3.0:1788925333.675132:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892122880 00000100:00100000:3.0:1788925333.675160:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00100000:3.0:1788925333.675167:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d105c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2384:x1875823892122880:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925333.675200:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d105c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2384:x1875823892122880:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925333.675206:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 121 00000100:00080000:3.0:1788925333.675233:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788925333.675238:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925333.675556:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892122752 00000100:00100000:0.0:1788925333.675561:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892122752 00000100:00100000:0.0:1788925333.675599:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 248 00000100:00100000:0.0:1788925333.675607:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892122752:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925333.675649:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2384:x1875823892122752:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 42us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925333.675656:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 248 00000020:00000080:1.0:1788925333.762539:0:11995:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffff590db30 00000004:00000080:1.0:1788925333.762561:0:11995:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9e0d3f558400 uarg=0000000000000000 00000004:00000080:1.0:1788925333.762612:0:11995:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9e0d3f558400 00000040:00080000:1.0:1788925333.763246:0:11995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925333.763460:0:11995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788925333.763523:0:11995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 80 off8272 00000004:00000080:1.0:1788925333.763560:0:11995:0:(mdd_device.c:1855:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl1', mask 0x0 00000004:02000000:1.0:1788925333.763563:0:11995:0:(mdd_device.c:471:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:3.0:1788925334.016165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925334.016295:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892123136 00000100:00100000:0.0:1788925334.016304:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892123136 00000100:00100000:0.0:1788925334.016358:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1788925334.016368:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+5:11409:x1875823892123136:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788925334.016386:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925334.016407:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4600/0xb29fc47e1a29172e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4bdfc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.016463:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291735 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.016476:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.016489:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925334.022050:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788925334.022059:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788925334.022211:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.022252:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4600/0xb29fc47e1a29172e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdfc expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.022273:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291735 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdfc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.022283:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1297e000) 00010000:00010000:1.0:1788925334.022286:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788925334.022289:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d2e5e4e00, rc 0) 00000100:00100000:1.0:1788925334.022414:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:11409:x1875823892123136:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 6046us (6256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925334.022423:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1788925334.034234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.035860:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892123392 00000100:00100000:3.0:1788925334.035872:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892123392 00000100:00100000:3.0:1788925334.035937:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:3.0:1788925334.035947:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:11409:x1875823892123392:12345-192.168.203.4@tcp:36:llapi_scan_chan.0 00010000:00010000:3.0:1788925334.035997:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925334.036021:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291735 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4bdfc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925334.036054:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d1297e000) 00010000:00010000:3.0:1788925334.036063:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925334.039242:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:11409:x1875823892123392:12345-192.168.203.4@tcp:36:llapi_scan_chan.0 Request processed in 3289us (5010us total) trans 0 rc -17/-17 00000100:00100000:3.0:1788925334.039254:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:3.0:1788925334.043516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925334.043663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892123520 00000100:00100000:2.0:1788925334.043673:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892123520 00000100:00100000:2.0:1788925334.043725:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:2.0:1788925334.043734:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:11409:x1875823892123520:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:2.0:1788925334.043789:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925334.043955:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9400/0xb29fc47e1a29173c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be03 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925334.044017:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9600/0xb29fc47e1a291743 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925334.044030:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9600/0xb29fc47e1a291743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925334.044072:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9600/0xb29fc47e1a291743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925334.044243:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788925334.044247:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788925334.044327:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9600/0xb29fc47e1a291743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925334.044352:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9400/0xb29fc47e1a29173c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be03 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925334.044368:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9600/0xb29fc47e1a291743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be03 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925334.044377:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286600) 00010000:00010000:2.0:1788925334.044380:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925334.044384:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed9600, rc 0) 00000100:00100000:2.0:1788925334.044444:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:11409:x1875823892123520:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 711us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925334.044452:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:2.0:1788925334.049149:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.053353:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892123648 00000100:00100000:3.0:1788925334.053368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892123648 00000100:00100000:0.0:1788925334.053517:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:0.0:1788925334.053545:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:11409:x1875823892123648:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788925334.053566:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925334.054112:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29174a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be0a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.054178:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.054191:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.054202:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.054215:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.054221:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.054228:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.055342:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5c00/0xb29fc47e1a29175f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.055356:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5c00/0xb29fc47e1a29175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.055364:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5c00/0xb29fc47e1a29175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925334.055465:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788925334.055470:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788925334.055554:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5c00/0xb29fc47e1a29175f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.055569:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.055577:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.055583:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.055607:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e5e00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925334.055612:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.055619:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.055632:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286600) 00010000:00010000:0.0:1788925334.055635:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925334.056541:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.056552:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.056570:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.056964:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.056971:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.056977:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4c00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925334.056980:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.056988:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.057000:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf03956b8 (ffff9e0d1297e400) 00010000:00010000:0.0:1788925334.057003:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925334.057006:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.057011:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a291758 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.057065:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29174a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be0a expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.057079:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5c00/0xb29fc47e1a29175f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be0a expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.057086:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:0.0:1788925334.057088:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788925334.057097:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d2e5e5c00, rc 0) 00000100:00100000:0.0:1788925334.057168:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+7:11409:x1875823892123648:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 3625us (8026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925334.057177:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 38 00000100:00100000:0.0:1788925334.062120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925334.062353:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892123904 00000100:00100000:1.0:1788925334.062362:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892123904 00000100:00100000:1.0:1788925334.062461:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788925334.062473:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+7:11409:x1875823892123904:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:1.0:1788925334.062493:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925334.062530:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a291766 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be11 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.062921:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.062936:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.062947:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.062961:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.062969:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.062975:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788925334.063698:0:6700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00000040:00080000:1.0:1788925334.063902:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925334.064094:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00010000:00010000:1.0:1788925334.064292:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a29177b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064305:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a29177b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064314:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a29177b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064359:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064366:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064372:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064377:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045800 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925334.064381:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064389:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064400:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:1.0:1788925334.064403:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925334.064408:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064414:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a29176d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925334.064426:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a64748f4 reply state 0000000082b46533 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925334.064435:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788925334.064466:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a291766 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be11 expref: 10 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064494:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a29177b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be11 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925334.064501:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9e0d03df8800) 00010000:00010000:1.0:1788925334.064503:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788925334.064506:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d42045e00, rc 0) 00000100:00100000:1.0:1788925334.064573:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+10:11409:x1875823892123904:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 2101us (2460us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788925334.064581:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00010000:00010000:0.0:1788925334.067549:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.067566:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.067573:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.067579:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044e00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925334.067596:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.067604:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.067620:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb1bed465 (ffff9e0d03df8000) 00010000:00010000:0.0:1788925334.067622:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925334.067626:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925334.067633:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044e00/0xb29fc47e1a291774 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925334.075133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925334.075202:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892124032 00000100:00100000:1.0:1788925334.075211:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892124032 00000100:00100000:1.0:1788925334.075260:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:1.0:1788925334.075270:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2381:x1875823892124032:12345-192.168.203.4@tcp:8:llapi_scan_chan.0 00010000:00080000:1.0:1788925334.075301:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:1.0:1788925334.075331:0:6676:0:(genops.c:1385:class_connect()) connect: client da20ab87-237b-453b-b2c0-9c81ec453d80, cookie 0xb29fc47e1a291789 00002000:00100000:1.0:1788925334.075343:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli da20ab87-237b-453b-b2c0-9c81ec453d80/ffff9e0d35516000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788925334.075365:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788925334.075579:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788925334.075614:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9e0d35513800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925334.075916:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2381:x1875823892124032:12345-192.168.203.4@tcp:8:llapi_scan_chan.0 Request processed in 644us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925334.075926:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:3.0:1788925334.082897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925334.083401:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892124160 00000100:00100000:2.0:1788925334.083411:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892124160 00000100:00100000:2.0:1788925334.083523:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788925334.083534:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:11409:x1875823892124160:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:2.0:1788925334.083550:0:10659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925334.083573:0:10659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be18 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788925334.083626:0:10659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788925334.083653:0:10659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1788925334.083658:0:10659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925334.083666:0:10659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be18 expref: 7 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925334.083684:0:10659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be18 expref: 7 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925334.083696:0:10659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed9400, rc 0) 00000100:00100000:2.0:1788925334.083782:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+7:11409:x1875823892124160:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 249us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925334.083789:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00080000:3.0:1788925334.086813:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925334.092680:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925334.092938:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892124288 00000100:00100000:2.0:1788925334.092947:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892124288 00002000:00100000:2.0:1788925334.092992:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->0) req@ffff9e0d066b3800 x1875823892124288/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925334.093003:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d066b3800 with x1875823892124288 ext(0->0) 00002000:00010000:2.0:1788925334.093008:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d066b3800 00000100:00100000:2.0:1788925334.093047:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:2.0:1788925334.093056:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+7:2382:x1875823892124288:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000001:00100000:0.0:1788925334.135021:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da20ab87-237b-453b-b2c0-9c81ec453d80 00000100:00100000:3.0:1788925334.135929:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892124288:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 42868us (43251us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788925334.135945:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00002000:00100000:3.0:1788925334.135957:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->0) req@ffff9e0d066b3800 x1875823892124288/t4294967299(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.135981:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d066b3800 with x1875823892124288 ext(0->0) 00002000:00010000:3.0:1788925334.135987:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d066b3800 00000100:00100000:0.0:1788925334.140109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.140205:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892124416 00000100:00100000:3.0:1788925334.140215:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892124416 00000100:00100000:3.0:1788925334.140308:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:3.0:1788925334.140319:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+9:11409:x1875823892124416:12345-192.168.203.4@tcp:44:llapi_scan_chan.0 00000001:00080000:0.0:1788925334.175429:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:3.0:1788925334.175907:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:11409:x1875823892124416:12345-192.168.203.4@tcp:44:llapi_scan_chan.0 Request processed in 35583us (35800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925334.175918:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 40 00000100:00100000:0.0:1788925334.179500:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925334.179724:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892124544 00000100:00100000:1.0:1788925334.179734:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892124544 00000100:00100000:1.0:1788925334.180128:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:1.0:1788925334.180138:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892124544:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925334.220675:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788925334.220883:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892124544:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 40741us (41386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925334.220894:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788925334.228197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.228318:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892124672 00000100:00100000:3.0:1788925334.228327:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892124672 00002000:00100000:3.0:1788925334.228384:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->1) req@ffff9e0d2f75dc00 x1875823892124672/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.228395:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2f75dc00 with x1875823892124672 ext(0->1) 00002000:00010000:3.0:1788925334.228400:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2f75dc00 00000100:00100000:3.0:1788925334.228432:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 1 00000100:00100000:3.0:1788925334.228443:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892124672:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925334.229238:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892124672:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 794us (1046us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788925334.229246:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 1 00002000:00100000:3.0:1788925334.229254:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->1) req@ffff9e0d2f75dc00 x1875823892124672/t4294967300(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.229275:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2f75dc00 with x1875823892124672 ext(0->1) 00002000:00010000:3.0:1788925334.229278:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2f75dc00 00000100:00100000:2.0:1788925334.234264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.234359:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892124800 00000100:00100000:3.0:1788925334.234368:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892124800 00000100:00100000:3.0:1788925334.234426:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:3.0:1788925334.234436:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892124800:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925334.264526:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1788925334.265190:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892124800:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 30748us (30927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925334.265204:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:0.0:1788925334.272710:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.272931:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892124928 00000100:00100000:3.0:1788925334.272942:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892124928 00002000:00100000:3.0:1788925334.273072:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->2) req@ffff9e0d2e7e1880 x1875823892124928/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.273085:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e7e1880 with x1875823892124928 ext(0->2) 00002000:00010000:3.0:1788925334.273090:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e7e1880 00000100:00100000:3.0:1788925334.273120:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 2 00000100:00100000:3.0:1788925334.273130:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892124928:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925334.273546:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2385:x1875823892124928:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 415us (840us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788925334.273554:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 2 00002000:00100000:3.0:1788925334.273561:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->2) req@ffff9e0d2e7e1880 x1875823892124928/t4294967301(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.273569:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e7e1880 with x1875823892124928 ext(0->2) 00002000:00010000:3.0:1788925334.273573:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e7e1880 00000100:00100000:1.0:1788925334.279522:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.279721:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892125056 00000100:00100000:3.0:1788925334.279768:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892125056 00000100:00100000:3.0:1788925334.280014:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:3.0:1788925334.280026:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3546b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892125056:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:2.0:1788925334.313452:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788925334.313635:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3546b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892125056:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 33605us (34115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925334.313654:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:0.0:1788925334.320481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.320554:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892125184 00000100:00100000:3.0:1788925334.320564:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892125184 00002000:00100000:3.0:1788925334.320623:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->3) req@ffff9e0d2e7e1500 x1875823892125184/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.320633:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e7e1500 with x1875823892125184 ext(0->3) 00002000:00010000:3.0:1788925334.320639:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e7e1500 00000100:00100000:3.0:1788925334.320804:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 3 00000100:00100000:3.0:1788925334.320814:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892125184:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925334.321413:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892125184:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 597us (937us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788925334.321421:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 3 00002000:00100000:3.0:1788925334.321429:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->3) req@ffff9e0d2e7e1500 x1875823892125184/t4294967302(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.321436:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e7e1500 with x1875823892125184 ext(0->3) 00002000:00010000:3.0:1788925334.321440:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e7e1500 00000100:00100000:0.0:1788925334.326491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925334.326690:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892125312 00000100:00100000:1.0:1788925334.326701:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892125312 00000100:00100000:1.0:1788925334.326811:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1788925334.326821:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892125312:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788925334.363650:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788925334.363912:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892125312:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 37086us (37422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925334.363923:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:1.0:1788925334.371247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925334.371326:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892125440 00000100:00100000:2.0:1788925334.371335:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892125440 00002000:00100000:2.0:1788925334.371381:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->4) req@ffff9e0d35468e00 x1875823892125440/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925334.371391:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d35468e00 with x1875823892125440 ext(0->4) 00002000:00010000:2.0:1788925334.371397:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d35468e00 00000100:00100000:2.0:1788925334.371427:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 4 00000100:00100000:2.0:1788925334.371437:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892125440:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925334.372056:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2385:x1875823892125440:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 619us (815us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788925334.372064:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 4 00002000:00100000:2.0:1788925334.372072:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->4) req@ffff9e0d35468e00 x1875823892125440/t4294967303(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925334.372080:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d35468e00 with x1875823892125440 ext(0->4) 00002000:00010000:2.0:1788925334.372084:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d35468e00 00000100:00100000:0.0:1788925334.376850:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925334.376982:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892125568 00000100:00100000:1.0:1788925334.376991:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892125568 00000100:00100000:1.0:1788925334.377051:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:1.0:1788925334.377060:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892125568:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788925334.406151:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788925334.406300:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892125568:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 29236us (29462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925334.406312:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 21 00000100:00100000:0.0:1788925334.412849:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.413078:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892125696 00000100:00100000:3.0:1788925334.413088:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892125696 00002000:00100000:3.0:1788925334.413135:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->5) req@ffff9e0d2e9df480 x1875823892125696/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.413146:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e9df480 with x1875823892125696 ext(0->5) 00002000:00010000:3.0:1788925334.413152:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e9df480 00000100:00100000:3.0:1788925334.413186:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 5 00000100:00100000:3.0:1788925334.413214:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892125696:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925334.413650:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2385:x1875823892125696:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 438us (822us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788925334.413658:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 5 00002000:00100000:3.0:1788925334.413664:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->5) req@ffff9e0d2e9df480 x1875823892125696/t4294967304(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.413672:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e9df480 with x1875823892125696 ext(0->5) 00002000:00010000:3.0:1788925334.413675:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e9df480 00000100:00100000:0.0:1788925334.418241:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.418583:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892125824 00000100:00100000:3.0:1788925334.418603:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892125824 00000100:00100000:3.0:1788925334.418663:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 22 00000100:00100000:3.0:1788925334.418672:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892125824:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000100:00100000:3.0:1788925334.448406:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892125824:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 29725us (30163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925334.448420:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 22 00000001:00080000:3.0:1788925334.448456:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:0.0:1788925334.460150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.460225:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892125952 00000100:00100000:3.0:1788925334.460233:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892125952 00002000:00100000:3.0:1788925334.460280:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->6) req@ffff9e0d2e9dfb80 x1875823892125952/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.460292:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e9dfb80 with x1875823892125952 ext(0->6) 00002000:00010000:3.0:1788925334.460297:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e9dfb80 00000100:00100000:3.0:1788925334.460328:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:3.0:1788925334.460336:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892125952:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925334.461596:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892125952:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 1247us (1440us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788925334.461607:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00002000:00100000:3.0:1788925334.461616:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->6) req@ffff9e0d2e9dfb80 x1875823892125952/t4294967305(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.461625:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e9dfb80 with x1875823892125952 ext(0->6) 00002000:00010000:3.0:1788925334.461630:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e9dfb80 00000100:00100000:3.0:1788925334.470491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925334.470689:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892126080 00000100:00100000:1.0:1788925334.470698:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892126080 00000100:00100000:1.0:1788925334.470924:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:1.0:1788925334.470935:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892126080:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925334.562990:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788925334.563162:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892126080:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 92224us (92676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925334.563172:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 23 00000100:00100000:0.0:1788925334.573186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925334.573319:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892126208 00000100:00100000:2.0:1788925334.573329:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892126208 00002000:00100000:2.0:1788925334.573390:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->7) req@ffff9e0d2e9de680 x1875823892126208/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925334.573401:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e9de680 with x1875823892126208 ext(0->7) 00002000:00010000:2.0:1788925334.573411:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e9de680 00000100:00100000:2.0:1788925334.573445:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788925334.573454:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892126208:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925334.579190:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892126208:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 5728us (6006us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788925334.579207:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00002000:00100000:2.0:1788925334.579217:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->7) req@ffff9e0d2e9de680 x1875823892126208/t4294967306(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 496/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925334.579228:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e9de680 with x1875823892126208 ext(0->7) 00002000:00010000:2.0:1788925334.579233:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e9de680 00000100:00100000:3.0:1788925334.600958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925334.601129:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892126336 00000100:00100000:1.0:1788925334.601138:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892126336 00000100:00100000:1.0:1788925334.601196:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:1.0:1788925334.601207:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d066b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892126336:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00010000:00010000:3.0:1788925334.663571:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788925334.735877:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1788925334.736174:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d066b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892126336:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 134963us (135219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925334.736185:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 24 00000100:00100000:0.0:1788925334.750630:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925334.750724:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892126464 00000100:00100000:3.0:1788925334.750733:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892126464 00002000:00100000:3.0:1788925334.750815:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->8) req@ffff9e0d2e9de300 x1875823892126464/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 504/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.750826:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e9de300 with x1875823892126464 ext(0->8) 00002000:00010000:3.0:1788925334.750842:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e9de300 00000100:00100000:3.0:1788925334.750877:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:3.0:1788925334.750887:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2e9de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892126464:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925334.751322:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2e9de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892126464:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 436us (700us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788925334.751331:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00002000:00100000:3.0:1788925334.751338:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->8) req@ffff9e0d2e9de300 x1875823892126464/t4294967307(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 504/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925334.751352:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2e9de300 with x1875823892126464 ext(0->8) 00002000:00010000:3.0:1788925334.751356:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2e9de300 00000100:00100000:3.0:1788925334.765309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925334.766800:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892126592 00000100:00100000:2.0:1788925334.766813:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892126592 00000100:00100000:2.0:1788925334.766891:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:2.0:1788925334.766901:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f99b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892126592:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925334.851852:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:2.0:1788925334.852050:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f99b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892126592:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 85145us (86744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925334.852060:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 25 00000100:00100000:0.0:1788925334.858502:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925334.858583:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892126720 00000100:00100000:2.0:1788925334.858592:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892126720 00002000:00100000:2.0:1788925334.858648:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->9) req@ffff9e0d06a9ca80 x1875823892126720/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 504/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925334.858659:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9ca80 with x1875823892126720 ext(0->9) 00002000:00010000:2.0:1788925334.858665:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9ca80 00000100:00100000:2.0:1788925334.858722:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:2.0:1788925334.858732:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892126720:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925334.859368:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892126720:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 635us (872us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788925334.859377:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00002000:00100000:2.0:1788925334.859384:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->9) req@ffff9e0d06a9ca80 x1875823892126720/t4294967308(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 504/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925334.859392:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9ca80 with x1875823892126720 ext(0->9) 00002000:00010000:2.0:1788925334.859396:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9ca80 00000100:00100000:3.0:1788925334.863368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925334.863820:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892126848 00000100:00100000:0.0:1788925334.863830:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892126848 00000100:00100000:0.0:1788925334.863886:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1788925334.863896:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892126848:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925334.912780:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788925334.912959:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892126848:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 49058us (49592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925334.912993:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 26 00000100:00100000:0.0:1788925334.933709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925334.933848:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892126976 00000100:00100000:2.0:1788925334.933857:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892126976 00002000:00100000:2.0:1788925334.933904:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->10) req@ffff9e0d06a9e300 x1875823892126976/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 504/0 e 0 to 0 dl 1788925345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925334.933914:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9e300 with x1875823892126976 ext(0->10) 00002000:00010000:2.0:1788925334.933920:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9e300 00000100:00100000:2.0:1788925334.933949:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:2.0:1788925334.933958:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892126976:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925334.934424:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892126976:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 465us (721us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788925334.934432:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00002000:00100000:2.0:1788925334.934440:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->10) req@ffff9e0d06a9e300 x1875823892126976/t4294967309(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:410/0 lens 504/448 e 0 to 0 dl 1788925345 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925334.934449:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9e300 with x1875823892126976 ext(0->10) 00002000:00010000:2.0:1788925334.934452:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9e300 00000100:00100000:3.0:1788925334.940805:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925334.940889:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892127104 00000100:00100000:1.0:1788925334.940897:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892127104 00000100:00100000:1.0:1788925334.940949:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:1.0:1788925334.940958:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2385:x1875823892127104:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788925334.991689:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1788925334.992475:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892127104:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 51510us (51671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925334.992486:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 27 00000100:00100000:0.0:1788925335.002691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.002841:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892127232 00000100:00100000:2.0:1788925335.002864:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892127232 00002000:00100000:2.0:1788925335.002909:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->11) req@ffff9e0d06a9ce00 x1875823892127232/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/0 e 0 to 0 dl 1788925346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.002918:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9ce00 with x1875823892127232 ext(0->11) 00002000:00010000:2.0:1788925335.002924:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9ce00 00000100:00100000:2.0:1788925335.002951:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 11 00000100:00100000:2.0:1788925335.002962:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892127232:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925335.003433:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892127232:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 471us (750us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788925335.003442:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 11 00002000:00100000:2.0:1788925335.003449:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->11) req@ffff9e0d06a9ce00 x1875823892127232/t4294967310(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/448 e 0 to 0 dl 1788925346 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.003458:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9ce00 with x1875823892127232 ext(0->11) 00002000:00010000:2.0:1788925335.003461:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9ce00 00000100:00100000:3.0:1788925335.018944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.020132:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892127360 00000100:00100000:2.0:1788925335.020145:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892127360 00000100:00100000:2.0:1788925335.020204:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 28 00000100:00100000:2.0:1788925335.020214:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892127360:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000100:00100000:0.0:1788925335.086556:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892127360:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 66333us (67611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925335.086569:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 28 00000001:00080000:3.0:1788925335.086775:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1788925335.104175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925335.106849:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892127488 00000100:00100000:3.0:1788925335.106866:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892127488 00002000:00100000:2.0:1788925335.110229:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9e0d06a9f100 x1875823892127488/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/0 e 0 to 0 dl 1788925346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.110245:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9f100 with x1875823892127488 ext(0->12) 00002000:00010000:2.0:1788925335.110253:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9f100 00000100:00100000:2.0:1788925335.110350:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 12 00000100:00100000:2.0:1788925335.110362:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892127488:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925335.110854:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2385:x1875823892127488:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 492us (6688us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788925335.110863:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 12 00002000:00100000:2.0:1788925335.110871:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9e0d06a9f100 x1875823892127488/t4294967311(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/448 e 0 to 0 dl 1788925346 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.110880:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9f100 with x1875823892127488 ext(0->12) 00002000:00010000:2.0:1788925335.110884:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9f100 00000100:00100000:1.0:1788925335.117052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.117213:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892127616 00000100:00100000:2.0:1788925335.117224:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892127616 00000100:00100000:2.0:1788925335.117281:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:2.0:1788925335.117293:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892127616:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788925335.170082:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:0.0:1788925335.171768:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892127616:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 54453us (54702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925335.171781:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:3.0:1788925335.190370:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.194788:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892127744 00000100:00100000:2.0:1788925335.194803:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892127744 00002000:00100000:2.0:1788925335.195071:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->13) req@ffff9e0d3f998a80 x1875823892127744/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/0 e 0 to 0 dl 1788925346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.195084:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d3f998a80 with x1875823892127744 ext(0->13) 00002000:00010000:2.0:1788925335.195089:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d3f998a80 00000100:00100000:2.0:1788925335.195186:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 13 00000100:00100000:2.0:1788925335.195197:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892127744:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925335.195669:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892127744:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 472us (5307us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788925335.195677:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 13 00002000:00100000:2.0:1788925335.195684:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->13) req@ffff9e0d3f998a80 x1875823892127744/t4294967312(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/448 e 0 to 0 dl 1788925346 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.195703:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d3f998a80 with x1875823892127744 ext(0->13) 00002000:00010000:2.0:1788925335.195706:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d3f998a80 00000100:00100000:2.0:1788925335.210326:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925335.210421:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892127872 00000100:00100000:0.0:1788925335.210430:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892127872 00000100:00100000:0.0:1788925335.210486:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1788925335.210496:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892127872:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788925335.285378:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:0.0:1788925335.285477:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892127872:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 74977us (75155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925335.285487:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:0.0:1788925335.293631:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.297532:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892128000 00000100:00100000:2.0:1788925335.297545:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892128000 00002000:00100000:0.0:1788925335.303490:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->14) req@ffff9e0d06a9d500 x1875823892128000/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/0 e 0 to 0 dl 1788925346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788925335.303506:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9d500 with x1875823892128000 ext(0->14) 00002000:00010000:0.0:1788925335.303514:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9d500 00000100:00100000:0.0:1788925335.303552:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 14 00000100:00100000:0.0:1788925335.303562:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d06a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892128000:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788925335.305539:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d06a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892128000:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 1970us (11908us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788925335.305552:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 14 00002000:00100000:0.0:1788925335.305562:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->14) req@ffff9e0d06a9d500 x1875823892128000/t4294967313(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/448 e 0 to 0 dl 1788925346 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788925335.305571:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d06a9d500 with x1875823892128000 ext(0->14) 00002000:00010000:0.0:1788925335.305577:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d06a9d500 00000100:00100000:0.0:1788925335.319081:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925335.320891:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892128128 00000100:00100000:1.0:1788925335.320903:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892128128 00000100:00100000:0.0:1788925335.321175:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:0.0:1788925335.321188:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892128128:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000100:00100000:1.0:1788925335.358398:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892128128:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 37202us (39315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925335.358411:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000001:00080000:3.0:1788925335.361609:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000100:00100000:2.0:1788925335.370686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925335.372973:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892128256 00000100:00100000:3.0:1788925335.372988:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892128256 00002000:00100000:3.0:1788925335.373056:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->15) req@ffff9e0d2f75d180 x1875823892128256/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/0 e 0 to 0 dl 1788925346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925335.373066:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2f75d180 with x1875823892128256 ext(0->15) 00002000:00010000:3.0:1788925335.373071:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2f75d180 00000100:00100000:3.0:1788925335.373147:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 15 00000100:00100000:3.0:1788925335.373159:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892128256:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788925335.373592:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2385:x1875823892128256:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 433us (2912us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788925335.373602:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 15 00002000:00100000:3.0:1788925335.373617:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->15) req@ffff9e0d2f75d180 x1875823892128256/t4294967314(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 504/448 e 0 to 0 dl 1788925346 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788925335.373626:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2f75d180 with x1875823892128256 ext(0->15) 00002000:00010000:3.0:1788925335.373630:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2f75d180 00000100:00100000:1.0:1788925335.397533:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.397632:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892128384 00000100:00100000:2.0:1788925335.397642:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892128384 00000100:00100000:2.0:1788925335.397702:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:2.0:1788925335.397713:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3546aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892128384:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788925335.513089:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788925335.513319:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3546aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892128384:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 115602us (115791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925335.513331:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 32 00000100:00100000:0.0:1788925335.522247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.522807:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892128512 00000100:00100000:2.0:1788925335.522817:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892128512 00002000:00100000:2.0:1788925335.522866:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->16) req@ffff9e0d2ea91880 x1875823892128512/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 512/0 e 0 to 0 dl 1788925346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.522878:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2ea91880 with x1875823892128512 ext(0->16) 00002000:00010000:2.0:1788925335.522884:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2ea91880 00000100:00100000:2.0:1788925335.522912:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 16 00000100:00100000:2.0:1788925335.522922:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892128512:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925335.523339:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892128512:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 416us (1098us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788925335.523347:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 16 00002000:00100000:2.0:1788925335.523354:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->16) req@ffff9e0d2ea91880 x1875823892128512/t4294967315(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 512/448 e 0 to 0 dl 1788925346 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.523363:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2ea91880 with x1875823892128512 ext(0->16) 00002000:00010000:2.0:1788925335.523373:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2ea91880 00000100:00100000:0.0:1788925335.546163:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.546293:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892128640 00000100:00100000:2.0:1788925335.546304:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892128640 00000100:00100000:2.0:1788925335.546355:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:2.0:1788925335.546365:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892128640:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788925335.573332:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788925335.573657:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892128640:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 27286us (27495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925335.573669:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 33 00000100:00100000:3.0:1788925335.587144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.587238:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892128768 00000100:00100000:2.0:1788925335.587247:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892128768 00002000:00100000:2.0:1788925335.587292:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->17) req@ffff9e0d3f99a300 x1875823892128768/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 512/0 e 0 to 0 dl 1788925346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.587304:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d3f99a300 with x1875823892128768 ext(0->17) 00002000:00010000:2.0:1788925335.587309:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d3f99a300 00000100:00100000:2.0:1788925335.587376:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 17 00000100:00100000:2.0:1788925335.587386:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2382:x1875823892128768:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925335.587840:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892128768:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 454us (703us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788925335.587849:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 17 00002000:00100000:2.0:1788925335.587856:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->17) req@ffff9e0d3f99a300 x1875823892128768/t4294967316(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 512/448 e 0 to 0 dl 1788925346 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.587864:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d3f99a300 with x1875823892128768 ext(0->17) 00002000:00010000:2.0:1788925335.587867:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d3f99a300 00000100:00100000:0.0:1788925335.594868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.594950:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892128896 00000100:00100000:2.0:1788925335.594975:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892128896 00000100:00100000:2.0:1788925335.595039:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:2.0:1788925335.595049:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892128896:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000100:00100000:0.0:1788925335.616942:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925335.616969:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911038720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925335.617039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925335.617102:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911038720 00000100:00100000:0.0:1788925335.617109:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911038720 00000100:00100000:0.0:1788925335.617154:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788925335.617161:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911038720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925335.617180:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 76611584 pending 1703936 free 3859808256 avail 3839885312 00000100:00100000:0.0:1788925335.617216:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875823911038720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925335.617240:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788925335.617259:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925335.617292:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875823911038720:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788925335.646244:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:2.0:1788925335.646443:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892128896:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 51390us (51578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925335.646453:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 34 00000100:00100000:3.0:1788925335.672496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925335.679093:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892129024 00000100:00100000:1.0:1788925335.679109:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892129024 00002000:00100000:2.0:1788925335.679255:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->18) req@ffff9e0d3f998e00 x1875823892129024/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 512/0 e 0 to 0 dl 1788925346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.679266:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d3f998e00 with x1875823892129024 ext(0->18) 00002000:00010000:2.0:1788925335.679272:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d3f998e00 00000100:00100000:2.0:1788925335.679309:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 18 00000100:00100000:2.0:1788925335.679319:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892129024:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925335.681289:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892129024:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 1962us (8793us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788925335.681300:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 18 00002000:00100000:2.0:1788925335.681311:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2:0x0] (0->18) req@ffff9e0d3f998e00 x1875823892129024/t4294967317(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 512/448 e 0 to 0 dl 1788925346 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.681321:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d3f998e00 with x1875823892129024 ext(0->18) 00002000:00010000:2.0:1788925335.681326:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d3f998e00 00010000:00010000:3.0:1788925335.688706:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925335.693145:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925335.700176:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892129152 00000100:00100000:1.0:1788925335.700190:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892129152 00000100:00100000:1.0:1788925335.700277:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:1.0:1788925335.700288:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892129152:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788925335.830279:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:0.0:1788925335.830460:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892129152:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 130169us (137320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925335.830472:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 35 00000100:00100000:0.0:1788925335.838226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925335.838317:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892129280 00000100:00100000:2.0:1788925335.838327:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892129280 00002000:00100000:2.0:1788925335.838375:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->19) req@ffff9e0d2ea90a80 x1875823892129280/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 512/0 e 0 to 0 dl 1788925346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.838409:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2ea90a80 with x1875823892129280 ext(0->19) 00002000:00010000:2.0:1788925335.838415:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2ea90a80 00000100:00100000:2.0:1788925335.838453:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 19 00000100:00100000:2.0:1788925335.838464:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892129280:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788925335.839081:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2383:x1875823892129280:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 616us (863us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788925335.839090:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 19 00002000:00100000:2.0:1788925335.839098:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->19) req@ffff9e0d2ea90a80 x1875823892129280/t4294967318(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:411/0 lens 512/448 e 0 to 0 dl 1788925346 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788925335.839107:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d2ea90a80 with x1875823892129280 ext(0->19) 00002000:00010000:2.0:1788925335.839110:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e0d2ea90a80 00000100:00100000:1.0:1788925335.849719:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925335.849990:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892129408 00000100:00100000:3.0:1788925335.850000:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892129408 00000100:00100000:3.0:1788925335.850073:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 36 00000100:00100000:3.0:1788925335.850084:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d084ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892129408:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000100:00100000:3.0:1788925335.991544:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d084ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2382:x1875823892129408:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 141451us (141823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925335.991558:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 36 00000001:00080000:1.0:1788925335.991928:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:3.0:1788925335.995282:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925335.995807:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892129664 00000100:00100000:1.0:1788925335.995816:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892129664 00000100:00080000:0.0:1788925335.995930:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925335.995970:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 6 00000100:00100000:1.0:1788925335.995982:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+8:11409:x1875823892129664:12345-192.168.203.4@tcp:35:llapi_scan_chan.0 00000001:00080000:1.0:1788925335.996555:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967311 00000001:00080000:1.0:1788925335.996774:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:1.0:1788925335.996892:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+11:11409:x1875823892129664:12345-192.168.203.4@tcp:35:llapi_scan_chan.0 Request processed in 909us (1615us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788925335.996901:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 6 00000020:00080000:1.0:1788925335.996906:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788925336.001538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925336.001624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892129792 00000100:00100000:2.0:1788925336.001643:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892129792 00000100:00100000:2.0:1788925336.001696:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:2.0:1788925336.001705:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2ea93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+11:11409:x1875823892129792:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:2.0:1788925336.001728:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925336.001771:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8e00/0xb29fc47e1a291797 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be1f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.001838:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.001852:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.001882:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.001944:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002152:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002161:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002473:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002481:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002488:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002494:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9a00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925336.002497:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002505:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002517:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:2.0:1788925336.002520:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925336.002525:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002538:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29179e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002550:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002557:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002563:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002568:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9200 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925336.002571:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002576:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002584:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff9e0d25286400) 00010000:00010000:2.0:1788925336.002586:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925336.002589:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002595:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9200/0xb29fc47e1a2917a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002637:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8e00/0xb29fc47e1a291797 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be1f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002657:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:2.0:1788925336.002659:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925336.002664:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8e00/0xb29fc47e1a291797 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be1f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.002673:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed8e00, rc 0) 00000100:00100000:2.0:1788925336.002731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2ea93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+11:11409:x1875823892129792:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 1026us (1201us total) trans 0 rc 301/301 00000100:00100000:2.0:1788925336.002739:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 41 00000100:00100000:2.0:1788925336.010396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925336.010526:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892130048 00000100:00100000:1.0:1788925336.010536:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892130048 00000100:00100000:1.0:1788925336.010602:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 0 00000100:00100000:1.0:1788925336.010611:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+11:11409:x1875823892130048:12345-192.168.203.4@tcp:36:llapi_scan_chan.0 00010000:00010000:1.0:1788925336.010661:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925336.010685:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a29177b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be11 expref: 11 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.010704:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9e0d03df8800) 00010000:00010000:1.0:1788925336.010713:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788925336.010737:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.010804:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.010813:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.010828:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.010834:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.010841:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.010853:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.010860:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.010866:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.011323:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.011332:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.011339:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925336.012343:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000194106a5 reply state 00000000a31b1eab transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925336.012356:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788925336.012363:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.012369:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.012375:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.012381:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044c00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:1.0:1788925336.012385:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.012392:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.012404:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:1.0:1788925336.012406:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925336.012410:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.012416:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925336.012427:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000194106a5 reply state 00000000a31b1eab transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925336.012444:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00010000:1.0:1788925336.012448:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000194106a5 reply state 00000000a31b1eab transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925336.012453:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1788925336.012534:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+12:11409:x1875823892130048:12345-192.168.203.4@tcp:36:llapi_scan_chan.0 Request processed in 1923us (2146us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788925336.012542:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 0 00010000:00010000:0.0:1788925336.014667:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014683:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014690:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014696:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045c00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.014701:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014707:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014721:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb1bed465 (ffff9e0d03df8300) 00010000:00010000:0.0:1788925336.014724:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925336.014727:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014784:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045c00/0xb29fc47e1a2917ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014806:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014812:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014817:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014822:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044600 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.014825:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014830:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014839:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff9e0d03df8000) 00010000:00010000:0.0:1788925336.014842:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925336.014844:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014849:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044600/0xb29fc47e1a2917b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014861:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014867:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014879:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014884:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045800 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.014887:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014892:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014900:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9e0d03df8c00) 00010000:00010000:0.0:1788925336.014902:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788925336.014905:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.014911:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045800/0xb29fc47e1a2917c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925336.020273:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.020341:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892130176 00000100:00100000:0.0:1788925336.020351:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892130176 00000100:00100000:0.0:1788925336.020408:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:0.0:1788925336.020419:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+11:11409:x1875823892130176:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788925336.020441:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925336.020459:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a2917c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.020529:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.020543:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.020570:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.020592:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.020599:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.020606:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.020900:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4600/0xb29fc47e1a2917dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.020909:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4600/0xb29fc47e1a2917dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.020917:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4600/0xb29fc47e1a2917dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925336.021037:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 20 00000004:00200000:0.0:1788925336.021043:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788925336.021063:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4600/0xb29fc47e1a2917dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021075:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4600/0xb29fc47e1a2917dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021083:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021099:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021106:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021112:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4000 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.021117:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021124:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021136:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:0.0:1788925336.021139:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925336.021144:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021150:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a2917cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021162:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021169:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021175:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021180:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4e00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.021191:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021197:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021205:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff9e0d1297e300) 00010000:00010000:0.0:1788925336.021208:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925336.021211:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021217:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a2917d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021249:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a2917c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be26 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021262:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4600/0xb29fc47e1a2917dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be26 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.021269:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9e0d1297e400) 00010000:00010000:0.0:1788925336.021271:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788925336.021274:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d2e5e4600, rc 0) 00000100:00100000:0.0:1788925336.021337:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+12:11409:x1875823892130176:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 920us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925336.021345:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 42 00000100:00100000:3.0:1788925336.026466:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925336.026551:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892130432 00000100:00100000:1.0:1788925336.026561:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892130432 00000100:00100000:1.0:1788925336.026636:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 43 00000100:00100000:1.0:1788925336.026648:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+12:11409:x1875823892130432:12345-192.168.203.4@tcp:36:llapi_scan_chan.0 00010000:00010000:1.0:1788925336.026707:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925336.026735:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4600/0xb29fc47e1a2917dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be26 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.026866:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9e0d1297e400) 00010000:00010000:1.0:1788925336.026877:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788925336.026899:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.026911:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.026920:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.026933:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.026967:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.026975:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.027235:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.027244:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.027252:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788925336.029357:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788925336.029370:0:6700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344956625707ns, next at 345956622682ns, rc = 0 00010000:00010000:0.0:1788925336.029456:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029476:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029487:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029496:0:6700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029502:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029508:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029575:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925336.029601:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029608:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029614:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029620:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045400 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.029623:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029636:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029658:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9e0d03df8600) 00010000:00010000:0.0:1788925336.029661:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788925336.029665:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029672:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045400/0xb29fc47e1a2917f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029689:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029695:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029700:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029706:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42044c00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.029709:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029714:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029721:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:0.0:1788925336.029723:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925336.029726:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.029731:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42044c00/0xb29fc47e1a2917e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788925336.029776:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000963f3632 reply state 000000007dd58903 transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925336.029784:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788925336.029873:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+13:11409:x1875823892130432:12345-192.168.203.4@tcp:36:llapi_scan_chan.0 Request processed in 3224us (3411us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788925336.029881:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 43 00010000:00010000:3.0:1788925336.031241:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925336.031252:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.031261:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4c00 already unused, calling callback (ffffffffc141f230) 00010000:00010000:3.0:1788925336.031265:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.031287:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.031302:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff9e0d03df8600) 00010000:00010000:3.0:1788925336.031304:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788925336.031308:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.031314:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4c00/0xb29fc47e1a2917f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.031332:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925336.031333:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925336.031335:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925336.032823:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.032837:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.032844:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.032850:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d42045e00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.032854:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.032861:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.032875:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff9e0d03df8800) 00010000:00010000:0.0:1788925336.032877:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925336.032881:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.032887:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d42045e00/0xb29fc47e1a2917eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925336.040028:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.040393:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892130688 00000100:00100000:0.0:1788925336.040401:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892130688 00000100:00100000:0.0:1788925336.040453:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:0.0:1788925336.040462:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f99bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+12:11409:x1875823892130688:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788925336.040485:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925336.040502:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a291800 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be2d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925336.040614:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788925336.040724:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a291800 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be2d expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.040738:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e0d25286600) 00010000:00010000:0.0:1788925336.040758:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788925336.040765:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a291800 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be2d expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.040777:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d2e5e4200, rc 0) 00000100:00100000:0.0:1788925336.041041:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f99bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+13:11409:x1875823892130688:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 578us (1028us total) trans 4294967316 rc 301/301 00000100:00100000:0.0:1788925336.041049:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 44 00000100:00100000:2.0:1788925336.045853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925336.046060:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892130944 00000100:00100000:3.0:1788925336.046068:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892130944 00000100:00100000:3.0:1788925336.046126:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:3.0:1788925336.046138:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+13:11409:x1875823892130944:12345-192.168.203.4@tcp:35:llapi_scan_chan.0 00000100:00100000:3.0:1788925336.046392:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11409:x1875823892130944:12345-192.168.203.4@tcp:35:llapi_scan_chan.0 Request processed in 256us (546us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788925336.046399:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 7 00000100:00100000:2.0:1788925336.052896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.052994:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892131072 00000100:00100000:0.0:1788925336.053003:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892131072 00000100:00100000:0.0:1788925336.053064:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:0.0:1788925336.053073:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11411:x1875823892131072:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 00000004:00000080:0.0:1788925336.053105:0:5838:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff9e0d32f0c7b8 00000040:00080000:0.0:1788925336.053218:0:5838:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788925336.053222:0:5838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1788925336.053249:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788925336.053254:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1788925336.053314:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11411:x1875823892131072:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 Request processed in 241us (425us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925336.053322:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 45 00000100:00100000:2.0:1788925336.076998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925336.077131:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892131200 00000100:00100000:3.0:1788925336.077140:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892131200 00000100:00100000:3.0:1788925336.077192:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:3.0:1788925336.077202:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11412:x1875823892131200:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 00000004:00000080:3.0:1788925336.077231:0:5840:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff9e0d32f0c8e0 00000040:00080000:3.0:1788925336.077328:0:5840:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788925336.077332:0:5840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1788925336.077359:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788925336.077365:0:5840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1788925336.077428:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11412:x1875823892131200:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 Request processed in 227us (438us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925336.077436:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 46 00000100:00100000:1.0:1788925336.096135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.096264:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892131328 00000100:00100000:0.0:1788925336.096274:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892131328 00000100:00100000:0.0:1788925336.096335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:0.0:1788925336.096346:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3546b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11413:x1875823892131328:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 00000004:00000080:0.0:1788925336.096378:0:5838:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff9e0d32f0ca08 00000040:00080000:0.0:1788925336.096456:0:5838:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788925336.096460:0:5838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1788925336.096508:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788925336.096515:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1788925336.096577:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3546b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11413:x1875823892131328:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 Request processed in 232us (450us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925336.096585:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 47 00000100:00100000:2.0:1788925336.109829:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925336.109960:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892131456 00000100:00100000:3.0:1788925336.109969:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892131456 00000100:00100000:3.0:1788925336.110015:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:3.0:1788925336.110035:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11414:x1875823892131456:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 00000004:00000080:3.0:1788925336.110063:0:5840:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff9e0d32f0cb30 00000040:00080000:3.0:1788925336.110139:0:5840:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788925336.110144:0:5840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1788925336.110178:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788925336.110185:0:5840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1788925336.110249:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11414:x1875823892131456:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 Request processed in 216us (428us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925336.110257:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 48 00000100:00100000:2.0:1788925336.123179:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.123277:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892131712 00000100:00100000:0.0:1788925336.123286:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892131712 00000100:00100000:0.0:1788925336.123382:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 49 00000100:00100000:0.0:1788925336.123393:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+14:11416:x1875823892131712:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788925336.123413:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925336.123433:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29180e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be34 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.123572:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.123660:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.123738:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.123793:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.123801:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.123808:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788925336.124560:0:6700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788925336.124780:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124792:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124801:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124833:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124852:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124859:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124865:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4e00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.124869:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124876:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124889:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:0.0:1788925336.124892:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925336.124896:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124902:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4e00/0xb29fc47e1a291815 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788925336.124916:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ec19e5d reply state 000000007d29668f transno 4294967318 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925336.124924:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788925336.124976:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29180e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be34 expref: 17 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.124991:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be34 expref: 16 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.125010:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e0d1297ec00) 00010000:00010000:0.0:1788925336.125012:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788925336.125015:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d2e5e5e00, rc 0) 00000100:00100000:0.0:1788925336.125102:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+17:11416:x1875823892131712:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 1710us (1928us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788925336.125110:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 49 00010000:00010000:0.0:1788925336.135231:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.135248:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.135255:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.135261:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d2e5e4000 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:0.0:1788925336.135266:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.135274:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.135294:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x37779e05 (ffff9e0d1297e300) 00010000:00010000:0.0:1788925336.135297:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925336.135302:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.135308:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a29181c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925336.139102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925336.139138:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892131968 00000100:00100000:2.0:1788925336.139546:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892131968 00000100:00100000:2.0:1788925336.139602:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 8 00000100:00100000:2.0:1788925336.139613:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+16:11416:x1875823892131968:12345-192.168.203.4@tcp:35:llapi_scan_chan.0 00000001:00080000:2.0:1788925336.140247:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000100:00100000:2.0:1788925336.140352:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+18:11416:x1875823892131968:12345-192.168.203.4@tcp:35:llapi_scan_chan.0 Request processed in 738us (1256us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788925336.140360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 8 00000020:00080000:2.0:1788925336.140382:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788925336.147007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925336.147555:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892132224 00000100:00100000:3.0:1788925336.147567:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892132224 00000100:00100000:3.0:1788925336.147630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 50 00000100:00100000:3.0:1788925336.147639:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+18:11416:x1875823892132224:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788925336.147662:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925336.148030:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ce00/0xb29fc47e1a291831 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be3b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.148179:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.148194:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.148959:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.148984:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.148993:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.149000:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788925336.151396:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788925336.151635:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a291846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.151651:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a291846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.151661:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a291846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.151938:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.151959:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.151966:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.151972:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8c400 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:3.0:1788925336.151977:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.151985:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.151998:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:3.0:1788925336.152001:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925336.152005:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.152010:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c400/0xb29fc47e1a291838 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788925336.152033:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab8fa44a reply state 000000002cf20edd transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925336.152043:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788925336.152085:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ce00/0xb29fc47e1a291831 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be3b expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.152100:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8c800/0xb29fc47e1a291846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be3b expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.152124:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e0d1810ea00) 00010000:00010000:3.0:1788925336.152126:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788925336.152129:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8c800, rc 0) 00000100:00100000:3.0:1788925336.152207:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+21:11416:x1875823892132224:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 4567us (5208us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788925336.152215:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 50 00010000:00010000:3.0:1788925336.154166:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.154181:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.154196:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.154203:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07d8ca00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:3.0:1788925336.154208:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.154214:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.154229:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7b008030 (ffff9e0d1810e600) 00010000:00010000:3.0:1788925336.154232:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925336.154236:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.154241:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a29183f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925336.158675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925336.158732:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892132480 00000100:00100000:3.0:1788925336.158765:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892132480 00000100:00100000:3.0:1788925336.158870:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 9 00000100:00100000:3.0:1788925336.158882:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+20:11416:x1875823892132480:12345-192.168.203.4@tcp:35:llapi_scan_chan.0 00000001:00080000:3.0:1788925336.159574:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788925336.159768:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+22:11416:x1875823892132480:12345-192.168.203.4@tcp:35:llapi_scan_chan.0 Request processed in 887us (1101us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788925336.159777:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 9 00000020:00080000:3.0:1788925336.159784:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788925336.172489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.172590:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892132736 00000100:00100000:0.0:1788925336.172600:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892132736 00000100:00100000:0.0:1788925336.172657:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1788925336.172668:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+22:11416:x1875823892132736:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788925336.172693:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925336.172714:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a291854 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be42 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.172862:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.172877:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be34 expref: 23 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.172886:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.172921:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be34 expref: 23 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.172935:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be34 expref: 23 pid: 6700 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925336.172949:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d2ea93100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875823911038848:192.168.203.4@tcp:104: 00000100:00100000:0.0:1788925336.173047:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d1146bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925336.178462:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d2ea93100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875823911038848:192.168.203.4@tcp:104: 00010000:00010000:0.0:1788925336.178492:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925336.179794:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.180890:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892132864 00000100:00100000:0.0:1788925336.180901:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892132864 00010000:00010000:0.0:1788925336.180943:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be34 expref: 24 pid: 6700 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925336.180986:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:0.0:1788925336.180997:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d2f75ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+24:2382:x1875823892132864:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788925336.181011:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925336.181029:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be34 expref: 24 pid: 6700 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.181043:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be34 expref: 24 pid: 6700 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.181065:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e5e00/0xb29fc47e1a291823 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be34 expref: 24 pid: 6700 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.181080:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e0d1297ec00) 00010000:00010000:0.0:1788925336.181085:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.181094:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.181101:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.181136:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788925336.181170:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.181181:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925336.181209:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00010000:00010000:3.0:1788925336.181367:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4000/0xb29fc47e1a291854 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be42 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.181384:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be42 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.181392:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e0d1297ec00) 00010000:00010000:3.0:1788925336.181395:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788925336.181397:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d2e5e4200, rc 0) 00000100:00100000:3.0:1788925336.181448:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+24:11416:x1875823892132736:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 8783us (8968us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788925336.181476:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 51 00000100:00100000:0.0:1788925336.181605:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d2f75ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+23:2382:x1875823892132864:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 609us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925336.181613:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 29 00000100:00100000:1.0:1788925336.188132:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.188276:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892132992 00000100:00100000:0.0:1788925336.188286:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892132992 00000100:00100000:3.0:1788925336.188411:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:3.0:1788925336.188426:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+23:11416:x1875823892132992:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788925336.188449:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925336.188468:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a291869 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be49 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.188526:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a291869 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be49 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.188540:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07d8ca00/0xb29fc47e1a291869 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be49 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.188558:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e0d1297ec00) 00010000:00010000:3.0:1788925336.188561:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788925336.188564:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07d8ca00, rc 0) 00000100:00100000:3.0:1788925336.188731:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+24:11416:x1875823892132992:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 309us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925336.188738:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 52 00000100:00100000:1.0:1788925336.197524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925336.202871:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892133120 00000100:00100000:2.0:1788925336.202886:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892133120 00000100:00100000:2.0:1788925336.202979:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:2.0:1788925336.202991:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:11416:x1875823892133120:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:2.0:1788925336.203008:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925336.203041:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006500b137/0xb29fc47e1a291870 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be50 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788925336.203064:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788925336.203069:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788925336.203091:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788925336.203096:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925336.203104:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006500b137/0xb29fc47e1a291870 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be50 expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.203124:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006500b137/0xb29fc47e1a291870 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be50 expref: 6 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.203138:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed8e00, rc 0) 00000100:00100000:2.0:1788925336.203212:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:11416:x1875823892133120:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 223us (5695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925336.203219:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 37 00000100:00100000:2.0:1788925336.223823:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.223908:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892133248 00000100:00100000:0.0:1788925336.223918:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892133248 00002000:00100000:0.0:1788925336.223980:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->0) req@ffff9e0d356c8e00 x1875823892133248/t0(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:412/0 lens 496/0 e 0 to 0 dl 1788925347 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788925336.223992:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d356c8e00 with x1875823892133248 ext(0->0) 00002000:00010000:0.0:1788925336.223997:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e0d356c8e00 00000100:00100000:0.0:1788925336.224039:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 20 00000100:00100000:0.0:1788925336.224051:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d356c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2384:x1875823892133248:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788925336.225485:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d356c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2384:x1875823892133248:12345-192.168.203.4@tcp:4:llapi_scan_chan.0 Request processed in 1430us (1667us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788925336.225497:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 20 00002000:00100000:0.0:1788925336.225507:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->0) req@ffff9e0d356c8e00 x1875823892133248/t4294967301(0) o4->da20ab87-237b-453b-b2c0-9c81ec453d80@192.168.203.4@tcp:412/0 lens 496/448 e 0 to 0 dl 1788925347 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788925336.225528:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e0d356c8e00 with x1875823892133248 ext(0->0) 00002000:00010000:0.0:1788925336.225534:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e0d356c8e00 00000100:00100000:3.0:1788925336.234526:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925336.234676:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892133376 00000100:00100000:2.0:1788925336.234704:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892133376 00000100:00100000:2.0:1788925336.234804:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1788925336.234815:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+24:11416:x1875823892133376:12345-192.168.203.4@tcp:44:llapi_scan_chan.0 00000001:00080000:3.0:1788925336.288135:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967318 is committed 00000004:00080000:3.0:1788925336.288151:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788925336.288178:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00000001:00080000:3.0:1788925336.288186:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967324 is committed 00000100:00100000:3.0:1788925336.288842:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d356cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911038976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788925336.288909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925336.289165:0:10659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911038976 00000100:00100000:2.0:1788925336.289173:0:10659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911038976 00000100:00100000:2.0:1788925336.289224:0:10659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788925336.289234:0:10659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875823911038976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788925336.289259:0:10659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00010000:00010000:2.0:1788925336.289285:0:10659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.289307:0:10659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be18 expref: 5 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.289316:0:10659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788925336.289320:0:10659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788925336.289325:0:10659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.289351:0:10659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be18 expref: 5 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.289365:0:10659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be18 expref: 5 pid: 10659 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925336.289377:0:10659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d356c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10659:1875823911039104:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788925336.289728:0:10659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d04be7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925336.297495:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da20ab87-237b-453b-b2c0-9c81ec453d80+10:11416:x1875823892133376:12345-192.168.203.4@tcp:44:llapi_scan_chan.0 Request processed in 62670us (62966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925336.297508:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 53 00000100:00100000:2.0:1788925336.298002:0:10659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d356c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10659:1875823911039104:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788925336.298375:0:10659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925336.302206:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925336.302312:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892133504 00000100:00100000:1.0:1788925336.302321:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892133504 00010000:00010000:1.0:1788925336.302377:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be18 expref: 6 pid: 10659 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925336.302422:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 30 00000100:00100000:1.0:1788925336.302432:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2383:x1875823892133504:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788925336.302446:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925336.302452:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be18 expref: 6 pid: 10659 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.302486:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be18 expref: 6 pid: 10659 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.302512:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d5bbb4/0xb29fc47e1a291790 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be18 expref: 6 pid: 10659 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.302529:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788925336.302533:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788925336.302539:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.302548:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925336.302582:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925336.302631:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2383:x1875823892133504:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 200us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925336.302639:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 30 00010000:00010000:3.0:1788925336.302644:0:10659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.302652:0:10659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.302662:0:10659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.302669:0:10659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.302685:0:10659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788925336.302912:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925336.303563:0:10659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875823911038976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14328us (14651us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788925336.303572:0:10659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788925336.303602:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925336.303607:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.303617:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9200 already unused, calling callback (ffffffffc141f230) 00010000:00010000:3.0:1788925336.303622:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.303631:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.303662:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.303670:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000392d1e3c/0xb29fc47e1a291877 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925336.303689:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925336.303691:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925336.303693:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788925336.305318:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e0d356cb800/2, rc 0, transno 4294967319 00000100:00100000:1.0:1788925336.305332:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d356cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875823911038976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788925336.307063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.307476:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892133632 00000100:00100000:0.0:1788925336.307502:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892133632 00000100:00100000:0.0:1788925336.307561:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:0.0:1788925336.307571:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3f99ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+8:2385:x1875823892133632:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788925336.403844:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788925336.404028:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3f99ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892133632:12345-192.168.203.4@tcp:16:llapi_scan_chan.0 Request processed in 96446us (96960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925336.404039:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 39 00000100:00100000:1.0:1788925336.418049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925336.418480:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892133760 00000100:00100000:2.0:1788925336.418490:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892133760 00000100:00100000:2.0:1788925336.418544:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:2.0:1788925336.418553:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3546b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+10:11416:x1875823892133760:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 00010000:00010000:2.0:1788925336.418572:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925336.418599:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29187e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x40a798f252f4be57 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.418660:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.418674:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.418684:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.418698:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.418705:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.418712:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.419068:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.419080:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be42 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.419089:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.419122:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be42 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.419134:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be42 expref: 11 pid: 5838 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925336.419147:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d356c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875823911039232:192.168.203.4@tcp:104: 00000100:00100000:2.0:1788925336.419238:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e0d0b681300 going to sleep for 11 seconds 00000100:00100000:0.0:1788925336.431202:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925336.431563:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892134016 00000100:00100000:3.0:1788925336.431573:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892134016 00000100:00100000:3.0:1788925336.431645:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 10 00000100:00100000:3.0:1788925336.431656:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d32fffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+12:5622:x1875823892134016:12345-192.168.203.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788925336.432906:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d356c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875823911039232:192.168.203.4@tcp:104: 00010000:00010000:2.0:1788925336.432934:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788925336.432990:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:0.0:1788925336.433148:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d32fffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+14:5622:x1875823892134016:12345-192.168.203.4@tcp:35:ldlm_bl.0 Request processed in 1492us (1953us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788925336.433157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 10 00000020:00080000:0.0:1788925336.433164:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788925336.442533:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:0.0:1788925336.442736:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892134144 00000100:00100000:0.0:1788925336.442776:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892134144 00010000:00010000:0.0:1788925336.442818:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be42 expref: 14 pid: 5838 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925336.442862:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 31 00000100:00100000:0.0:1788925336.442872:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35469180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+14:2382:x1875823892134144:12345-192.168.203.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788925336.442887:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925336.442894:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be42 expref: 14 pid: 5838 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.442907:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be42 expref: 14 pid: 5838 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.442929:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d2e5e4200/0xb29fc47e1a29185b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be42 expref: 14 pid: 5838 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.442954:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e0d1297ec00) 00010000:00010000:0.0:1788925336.442974:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.442983:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.442990:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925336.443026:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925336.443073:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443082:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925336.443082:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35469180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+13:2382:x1875823892134144:12345-192.168.203.4@tcp:103:ldlm_bl.0 Request processed in 213us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925336.443091:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 31 00000004:00200000:2.0:1788925336.443124:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 1 00000004:00200000:2.0:1788925336.443135:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788925336.443158:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443171:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443180:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443185:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443192:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443198:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed9000 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925336.443202:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443208:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443218:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e0d1297e200) 00010000:00010000:2.0:1788925336.443221:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925336.443224:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443504:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9000/0xb29fc47e1a291885 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443516:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443534:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443540:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443545:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e0d07ed8a00 already unused, calling callback (ffffffffc1e5e4f0) 00010000:00010000:2.0:1788925336.443548:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443556:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443565:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x37779e05 (ffff9e0d25286100) 00010000:00010000:2.0:1788925336.443567:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925336.443570:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443576:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8a00/0xb29fc47e1a29188c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443612:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed9a00/0xb29fc47e1a29187e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be57 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443626:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e0d07ed8000/0xb29fc47e1a291893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.4@tcp remote: 0x40a798f252f4be57 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925336.443634:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e0d1297ec00) 00010000:00010000:2.0:1788925336.443636:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788925336.443645:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e0d07ed8000, rc 0) 00000100:00100000:2.0:1788925336.443678:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3546b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da20ab87-237b-453b-b2c0-9c81ec453d80+12:11416:x1875823892133760:12345-192.168.203.4@tcp:101:llapi_scan_chan.0 Request processed in 25126us (25638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925336.443685:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 54 00000100:00100000:1.0:1788925336.450291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:3.0:1788925336.450797:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892134272 00000100:00100000:3.0:1788925336.450807:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892134272 00000100:00100000:3.0:1788925336.450871:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:3.0:1788925336.450881:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3546bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+12:11416:x1875823892134272:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 00000004:00000080:3.0:1788925336.450916:0:5838:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff9e0d32f0d968 00000040:00080000:3.0:1788925336.451171:0:5838:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788925336.451177:0:5838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1788925336.451218:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788925336.451319:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1788925336.451395:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3546bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+12:11416:x1875823892134272:12345-192.168.203.4@tcp:53:llapi_scan_chan.0 Request processed in 514us (1111us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788925336.451403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 55 00000100:00100000:2.0:1788925336.641031:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d356ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911039616:0@lo:400:kworker.0 00000100:00100000:2.0:1788925336.641099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925336.641160:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925336.641167:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d356cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823911039488:0@lo:400:kworker.0 00000100:00100000:2.0:1788925336.641188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925336.641217:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911039616 00000100:00100000:2.0:1788925336.641223:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911039616 00000100:00100000:2.0:1788925336.641264:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911039488 00000100:00100000:2.0:1788925336.641266:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911039488 00000100:00100000:2.0:1788925336.641284:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788925336.641291:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d356caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911039616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925336.641340:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d356caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875823911039616:12345-0@lo:400:kworker.0 Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925336.641347:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788925336.641362:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788925336.641368:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d356cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823911039488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925336.641393:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d356cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875823911039488:12345-0@lo:400:kworker.0 Request processed in 26us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925336.641399:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788925336.641432:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d356cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875823911039488:0@lo:400:kworker.0 00000100:00100000:2.0:1788925336.641443:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d356ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875823911039616:0@lo:400:kworker.0 00000100:00080000:0.0:1788925336.641543:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925336.641927:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d356c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911039360:0@lo:400:kworker.0 00000100:00100000:1.0:1788925336.641985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925336.642126:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d356c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911039872:0@lo:400:kworker.0 00000100:00100000:1.0:1788925336.642153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925336.642187:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925336.642193:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d356c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911039744:0@lo:400:kworker.0 00000100:00100000:1.0:1788925336.642214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925336.642300:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911039360 00000100:00100000:0.0:1788925336.642305:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911039360 00000100:00100000:0.0:1788925336.642338:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788925336.642345:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911039360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925336.642400:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911039744 00000100:00100000:1.0:1788925336.642404:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911039744 00000100:00100000:1.0:1788925336.642435:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788925336.642441:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911039744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925336.642502:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911039872 00000100:00100000:2.0:1788925336.642513:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911039872 00000100:00100000:2.0:1788925336.642541:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788925336.642548:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911039872:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788925336.644551:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925336.644560:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925336.662117:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76f68b46-a017-4297-a662-44212e04e46d+19:3305:x1875823911039360:12345-0@lo:400:kworker.0 Request processed in 19762us (20121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925336.662133:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788925336.662222:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d356c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:76f68b46-a017-4297-a662-44212e04e46d:3305:1875823911039360:0@lo:400:kworker.0 00000100:00100000:1.0:1788925336.662440:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875823911039744:12345-0@lo:400:kworker.0 Request processed in 19997us (20223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925336.662449:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788925336.662550:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875823911039872:12345-0@lo:400:kworker.0 Request processed in 20001us (20393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925336.662559:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788925336.662863:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d356c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875823911039744:0@lo:400:kworker.0 00000100:00100000:0.0:1788925336.662876:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d356c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875823911039872:0@lo:400:kworker.0 00010000:00010000:3.0:1788925336.706469:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925337.153903:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925337.153927:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e0d356ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911040000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925337.154010:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925337.154119:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823911040000 00000100:00100000:2.0:1788925337.154127:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823911040000 00000100:00100000:2.0:1788925337.154176:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788925337.154186:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d356cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911040000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925337.154209:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788925337.154254:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d356cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875823911040000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925337.154274:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788925337.154327:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e0d356ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875823911040000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925337.733148:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788925338.151632:0:12048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_157d: @@@@@@ FAIL: llapi_scan_changelog_test failed 00010000:00010000:3.0:1788925338.762330:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925338.791852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925338.791897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925338.791934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:1.0:1788925338.791980:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.4@tcp (source: 12345-192.168.203.4@tcp) 00000100:00100000:2.0:1788925338.792181:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892134656 00000100:00100000:2.0:1788925338.792192:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892134656 00000100:00100000:2.0:1788925338.792248:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892134784 00000100:00100000:2.0:1788925338.792252:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892134784 00000100:00100000:2.0:1788925338.792274:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:2.0:1788925338.792284:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3546a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892134656:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925338.792350:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3546a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+5:2385:x1875823892134656:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 67us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925338.792374:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 68 00000100:00100000:2.0:1788925338.792394:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:2.0:1788925338.792401:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d35469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892134784:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:2.0:1788925338.792426:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d35469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da20ab87-237b-453b-b2c0-9c81ec453d80+6:2385:x1875823892134784:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925338.792432:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 69 00000100:00100000:0.0:1788925338.792519:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892134400 00000100:00100000:0.0:1788925338.792525:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892134400 00000100:00100000:0.0:1788925338.792569:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:0.0:1788925338.792577:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d07f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892134400:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:0.0:1788925338.792620:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d07f6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a0672e-be75-4e81-8f5e-86be0fa2f83f+10:2385:x1875823892134400:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 34us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925338.792628:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 250 00000100:00100000:3.0:1788925338.792946:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823892134528 00000100:00100000:3.0:1788925338.793074:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875823892134528 00000100:00100000:3.0:1788925338.793117:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00100000:3.0:1788925338.793126:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e0d3546b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+12:2385:x1875823892134528:12345-192.168.203.4@tcp:400:kworker.0 00000100:00100000:3.0:1788925338.793158:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e0d3546b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da20ab87-237b-453b-b2c0-9c81ec453d80+12:2385:x1875823892134528:12345-192.168.203.4@tcp:400:kworker.0 Request processed in 35us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925338.793165:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.4@tcp, seq: 125 00000100:00080000:1.0:1788925338.793267:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925338.793272:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925338.793274:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788925339.777927:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 11240 lines, 11240 kept, 0 dropped, 0 bad.